Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/40—Support for services or applications
  • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L12/00—Data switching networks
  • H04L12/02—Details
  • H04L12/16—Arrangements for providing special services to substations
  • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L12/00—Data switching networks
  • H04L12/02—Details
  • H04L12/16—Arrangements for providing special services to substations
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L12/00—Data switching networks
  • H04L12/02—Details
  • H04L12/16—Arrangements for providing special services to substations
  • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
  • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
  • H04L12/1818—Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L12/00—Data switching networks
  • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L12/00—Data switching networks
  • H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/1066—Session management
  • H04L65/1083—In-session procedures
  • H04L65/1094—Inter-user-equipment sessions transfer or sharing
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M3/00—Automatic or semi-automatic exchanges
  • H04M3/42—Systems providing special services or facilities to subscribers
  • H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
  • H04M3/567—Multimedia conference systems
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M7/00—Arrangements for interconnection between switching centres
  • H04M7/12—Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal
  • H04M7/1205—Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal where the types of switching equipement comprises PSTN/ISDN equipment and switching equipment of networks other than PSTN/ISDN, e.g. Internet Protocol networks
  • H04M7/1225—Details of core network interconnection arrangements
  • H04M7/1235—Details of core network interconnection arrangements where one of the core networks is a wireless network
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M7/00—Arrangements for interconnection between switching centres
  • H04M7/12—Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal
  • H04M7/1205—Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal where the types of switching equipement comprises PSTN/ISDN equipment and switching equipment of networks other than PSTN/ISDN, e.g. Internet Protocol networks
  • H04M7/128—Details of addressing, directories or routing tables
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M7/00—Arrangements for interconnection between switching centres
  • H04M7/12—Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal
  • H04M7/1205—Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal where the types of switching equipement comprises PSTN/ISDN equipment and switching equipment of networks other than PSTN/ISDN, e.g. Internet Protocol networks
  • H04M7/129—Details of providing call progress tones or announcements
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M7/00—Arrangements for interconnection between switching centres
  • H04M7/12—Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal
  • H04M7/1205—Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal where the types of switching equipement comprises PSTN/ISDN equipment and switching equipment of networks other than PSTN/ISDN, e.g. Internet Protocol networks
  • H04M7/1295—Details of dual tone multiple frequency signalling
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
  • H04M2201/38—Displays

Definitions

• This invention relates to multimedia teleconferencing methods and devices and, in particular, to improved methods, devices, and systems for establishing dataconferencing sessions between two or more geographically remote conference sites using distributed control.
• Videoconferencing systems typically do not provide convenient tabletop connectivity for integrating presentation images with the video transmission. Rather, it may be necessary to adjust the videoconferencing system so that its video camera is aimed toward a screen where presentation images are displayed, e.g., via a computer display or multimedia projector.
• IP address Internet Protocol address
• IP addresses may also be dynamically allocated to computers within a network domain or corporate subnet via Dynamic Host Configuration Protocol ("DHCP") and may be valid only within the domain or corporate subnet and not directly addressable from outside of it, due to the use of proxy servers or network address translation (NAT) service.
• DHCP Dynamic Host Configuration Protocol
• NAT network address translation
• U.S. Patent No. 6,233,605 of Watson describes a low-bandwidth remote conferencing system that uses a PSTN for the audio component and networked computers for the visual component.
• data representing visual images is distributed to computers of conference participants.
• one participant, a leader periodically issues selection signals to all computers, causing them all to select one of the distributed images and display it.
• the selection signals and the telephone conference are carried by a single voice-grade telephone channel.
• the system requires distribution of the presentation images in advance of the telephone conference and does not address the desire to avoid manual interaction with the computer at each site to initiate downloading of the image data.
• budget planning and review sessions, design conferences, and distance learning could all benefit from the ability to interact with a software program at one or more of the sites, and have the software program display its output all of the participating sites nearly simultaneously.
• the system of Watson may undesirably leave residual image data on participant computers.
• a need exists for a dataconferencing system that allows on-demand distribution of presentation content and control of remote presentation displays on-the-fly, without the use of an expensive centralized data storage server and without user interaction at each remote conference site.
• each of two or more geographically separate conference sites has a telephone receiver and a dataconferencing appliance coupled to a voice call network, such as a Public Switched Telephone Network ("PSTN") or Private Branch Exchange (“PBX").
• PSTN Public Switched Telephone Network
• PBX Private Branch Exchange
• Each site also has a display device, such as a computer display screen or an electronic projector, for displaying images comprised of image data produced by an image source.
• a network interface at each site couples a dataconference control unit of the dataconferencing appliance to a data network that links the sites independently of the voice call network.
• a voice call session is first established between the telephone receivers via the voice call network.
• An access negotiation procedure implemented in software or hardware on the dataconference control units is then manually initiated at a first one of the sites to identify a network device access code and communicate it to at least a second one of the sites.
• the network device access code is communicated by generating an audio signal representative of the network device access code and transmitting it within the voice call session.
• the access negotiation procedure of the dataconference control unit at the second site uses its network interface module and the received network device access code to join a data communication session between the sites via the data network, thereby eliminating any need for dataconference participants to identify the network device access code or to personally interact to establish a data communication session.
• images are then conveniently transmitted between the sites via the data network for display on the display devices and the audio portion of the conference call is resumed on the voice call using the telephone receivers at each site.
• the dataconferencing appliance, telephone receiver, and network interface are integrated in a dataconferencing speakerphone appliance that can be conveniently positioned on a conference table at each of the sites and coupled to the data network, the voice call network, and the display device to facilitate dataconferencing in accordance with the. present invention.
• a manually activatable input key is provided for initiating the access negotiation procedure.
• the dataconference control unit is implemented in software operating on a computer workstation that can also serve as the display device, telephone receiver, and/ or image source; or in hardware as a simplified dataconferencing appliance that can be used with a separate telephone receiver, display device, and image source.
• Dataconferencing appliances in accordance with the invention may include network connectors and automatic network configuration routines for simplifying connection of an image source, such as a presenter's laptop computer, to the data network.
• FIG. 1 is a block diagram of a simplified dataconferencing system including local and remote dataconferencing appliances in accordance with a first preferred embodiment of the present invention
• FIG. 2 is a flow chart depicting a dataconferencing method performed by the system of FIG. 1;
• FIG. 3 is a network diagram showing the dataconferencing system of FIG. 1 operating between a local dataconferencing site and a remote dataconferencing site;
• FIG. 4 is a network diagram showing a second preferred embodiment dataconferencing system, including network-enabled projectors having integrated network interfaces for communication therebetween over a data network;
• FIG. 5 is a network diagram showing a third preferred embodiment dataconferencing system, including a laptop computer serving as an image source that is directly connected to one of the display devices;
• FIG. 6 is a network diagram showing a fourth preferred embodiment dataconferencing system, in which the network interface of one of the dataconferencing appliances includes a modem for accessing the data network via a dial-up connection to an Internet service provider ("ISP");
• ISP Internet service provider
• FIG. 7 is a network diagram showing a fifth preferred embodiment dataconferencing system, in which the local dataconferencing appliance includes wireless networking equipment for communication with a local wireless-enabled projector and a local wireless-enabled image source device;
• FIG. 8 is a network diagram of the dataconferencing system of FIG. 7 in which the local dataconferencing appliance further includes wireless networking hardware for communication with an infrastructure wireless networking access point;
• FIG. 9 is a network diagram showing a sixth preferred embodiment dataconferencing system in which two image source devices are used to generate image content concurrently and share the image content between the sites for display on the display devices in split-screen format;
• FIG. 10 is a network diagram showing a seventh preferred embodiment dataconferencing system including an integrated dataconferencing speakerphone appliance
• FIG. 11 is a network diagram showing a eighth preferred embodiment dataconferencing system including an combined dataconferencing speakerphone appliance and projector;
• FIG. 12 is a network diagram showing five conference sites participating in a dataconference in accordance with the present invention, including one site without a display device and another site having a dataconference control unit embodied in software on a computer workstation;
• FIG. 13 is an enlarged pictorial view of the integrated dataconferencing speakerphone appliance of FIG. 10;
• FIG. 14 is a pictorial view of the dataconferencing speakerphone appliance of
• FIG. 13 showing retractable network and peripheral cables being extended from the appliance for connection to a laptop computer
• FIG. 15 is a state diagram depicting steps in an IP address exchange procedure of a dataconference control unit operating in accordance with an embodiment of the present invention.
• FIG. 16 is a block diagram of an alternative embodiment dataconferencing system including an Internet conference server for use of the invention with a computer network firewall.
• data network a network for transmitting data encoded as digital signals, including, e.g., local area networks (LANs), wide area networks (WANs), and the Internet; a data network may include one or more modem transmission path segments that transmit data in analog form over a voice network but that are exclusive of voice communication sessions; data networks are distinguished from voice networks, which are designed to handle voice calls for transmission of analog signals representing audio and not specifically designed to carry digital data.
• LANs local area networks
• WANs wide area networks
• data networks may include one or more modem transmission path segments that transmit data in analog form over a voice network but that are exclusive of voice communication sessions; data networks are distinguished from voice networks, which are designed to handle voice calls for transmission of analog signals representing audio and not specifically designed to carry digital data.
• DHCP dynamic host configuration protocol
• DHCP servers typically also include a proxy server or network address translation (NAT) server that allows hosts to be addressable within a domain but not from outside of the domain.
• NAT network address translation
• display device any device for displaying characters or images including direct- view displays such as computer monitors, raster displays, and the like, as well as indirect displays such as electronic projector devices of the type sold by InFocus Corporation, Wilsonville, Oregon, USA, the assignee of the present application, regardless of where mounted and whether or not capable of direct connection to a data network.
• DTMF dual-tone multi-frequency
• image source a device that generates, produces, or reproduces a set or stream of data representing one or more still images or video frames; example image sources include personal computers, laptop computers, video playback devices such as DVD players and VCRs (with either analog or digital video outputs), digital cameras (still or motion-picture, including “webcams”), digitizing scanners, and personal digital assistants (PDAs).
• PDAs personal digital assistants
• independent voice and data networks - voice and data networks as defined herein, through which parallel, exclusive voice call and data network sessions are established; the equipment of a voice network (typically circuit switching) is often physically distinct from equipment of a data network (usually packet switching), but it need not be so; however, a data network session is always logically distinct and separate from a voice call session, even if the data network session includes an analog or DSP modem transmission path segment carried by a POTS network and even if voice calls are carried by data network equipment, e.g., using voice-over-IP technology.
• key or "input key” - a interface device such as a pushbutton, a switch, or a software button capable of being activated by a mouseclick or other computer input action; or any other input device for receiving one or more bits of data used to initiate negotiation procedures of the invention or to trigger other events within the system of the present invention.
• network device access code or “network access code” - any type of address or code for accessing a device on a data network
• example network access codes may include, without limitation, network addresses such as domain names, uniform resource locators (URLs), IP addresses (including static, dynamic, symbolic, and virtual addresses) compliant with IPv4 or IPv6 (including IPv4 with classless interdomain routing (CIDR)), and physical addresses (e.g., Ethernet addresses); and/or passcodes such as session identification codes, passwords, cookies, encryption codes or keys, and digital signatures.
• network addresses such as domain names, uniform resource locators (URLs), IP addresses (including static, dynamic, symbolic, and virtual addresses) compliant with IPv4 or IPv6 (including IPv4 with classless interdomain routing (CIDR)), and physical addresses (e.g., Ethernet addresses); and/or passcodes such as session identification codes, passwords, cookies, encryption codes or keys, and digital signatures.
• URLs uniform resource locators
• IP addresses including static, dynamic, symbolic, and virtual addresses
• POTS acronym for "plain old telephone system”; a widely-used suite of telephone interface and protocol standards that provides interoperability between the networks of voice telephone services providers worldwide; POTS networks typically include circuit switched telephone networks and equipment for use therewith, although some packet switched networks may also interface with POTS networks.
• PSTN Public Switched Telephone Network
• telephone receiver all types of devices capable of connection to a voice network for receiving analog or digital signals representative of audio telecommunications, including, without limitation, POTS telephone receiver sets, ISDN telephone receivers, VoIP telephones, speakerphones, headsets, wireless telephone handsets, cellular or PCS telephones, computer workstations with telephone emulation software and any other analog or packet telephone devices.
• voice call or "voice call session” - any audio communication session in which a caller dials a telephone number assigned to the call recipient's telephone receiver, causing an incoming call indication (usually ringing) at the recipient's telephone receiver; a voice call session begins after the call recipient answers his or her telephone receiver; voice calls are typically carried by a POTS network, but may be carried by any other communication network, provided that the voice call session is logically separate from and not interlinked with any digital data network sessions.
• voice network any network configured to handle voice calls; typically a
• POTS network but possibly including packet-switched networks and portions of data networks over which a voice-over-IP call is made.
• VoIP voice-over-IP
• VoIP an audio call in which at least one end-segment of the call path traverses a data network; VoIP involves digitizing the audio signal, transmitting the digitized signal over a packet-switched data network using Internet Protocol (IP), and converting the digitized signal back to analog audio for listening at the receiving end of the audio call.
• IP Internet Protocol
• FIG. 1 is a block diagram of a simplified dataconferencing system 100 operating at a local site 102 and a remote site 104 in accordance with a first preferred embodiment of the present invention.
• local site 102 includes a local speakerphone 110 including a local dataconferencing appliance 112.
• a local display device 114 such as a projector, and an image source 116, such as a laptop computer, are also connected to local dataconferencing appliance 112.
• Remote site 104 includes a remote speakerphone 120 connected to a remote dataconferencing appliance 122, which is in turn connected to a remote display device 124.
• Local and remote dataconferencing appliances 112 and 122 include respective local and remote dataconference control units 128 and 130, which are coupled to a data network 132 via respective local and remote network interfaces 134 and 136 of dataconferencing appliances 112 and 122.
• Local and remote network interfaces 134 and 136 are preferably integrated with local and remote dataconference control units 128 and 130, for example in the form of diskless embedded computers loaded with software embodying dataconferencing methods in accordance with the present invention, as described below with reference to FIG. 2.
• Local and remote dataconferencing appliances 112 and 122 also include respective local and remote telephone adapters 140 and 142 coupled to a voice network 146 via an incoming telephone line (RJ-11 jack), a handset line of a telephone receiver (RJ-22 jack), or any other means for communicating audio signals of a voice call.
• Local and remote telephone adapters 140 and 142 are connected to the respective local and remote dataconference control units 128 and 130, e.g., via a PCI bus or parallel port (not shown), and to speakerphones 110 and 120, respectively, e.g., via RJ-11 jacks, RJ-22 jacks, or other telephone audio lines (not shown).
• the components and arrangement of local speakerphone appliance 110, local dataconferencing appliance 112, and local display device 114 may be identical to the corresponding remote speakerphone 120, remote dataconferencing appliance 122, and remote display device 124, both in design and arrangement, i.e., system 100 may be symmetric across local and remote sites 102 and 104.
• the components of system 100 need not be symmetric or, for that matter, identical.
• different schemes of partitioning or integrating some or all of the components of dataconferencing system 100 are within the scope of the present invention, as further described below with reference to FIGS. 3-12.
• dataconferencing systems in accordance with the present invention need not be limited to two sites and can be used to establish dataconferencing sessions with more than two sites, as described below with reference to FIG. 12.
• FIG. 2 is a flow chart depicting a dataconferencing method 200 performed by dataconferencing system 100 of FIG. 1.
• a voice call 148 (represented by a call path through voice network 146 in FIG. 1) is established between local and remote speakerphones 110 and 120 (step 210).
• Noice call 148 may be established using conventional telephone dialing (e.g., 7-digit, 10-digit, or 11-digit dialing within North America; international dialing; and 3-digit, 4-digit, or 5-digit dialing within a PBX network), or by other methods, e.g., using VoIP calling methods.
• conventional telephone dialing e.g., 7-digit, 10-digit, or 11-digit dialing within North America; international dialing; and 3-digit, 4-digit, or 5-digit dialing within a PBX network
• other methods e.g., using VoIP calling methods.
• Each of the telephone adapters 140 and 142 may include an audio bridge (not shown) that couples respective speakerphones 110 and 120 to voice network 146 and which allows telephone adapters 140 and 142 to passively monitor the telephone line to determine its status, for example, whether the speakerphones 110 and 120 are off-hook and whether voice call 148 has been established.
• an audio bridge (not shown) that couples respective speakerphones 110 and 120 to voice network 146 and which allows telephone adapters 140 and 142 to passively monitor the telephone line to determine its status, for example, whether the speakerphones 110 and 120 are off-hook and whether voice call 148 has been established.
• a user at one or both of the sites 102 and 104 manually activates system 100 at any time during the voice call session using an input key (not shown) located on an initiating one of the dataconferencing appliances 112 and 122.
• the input key is a pushbutton that can be manually actuated by a user.
• Manually activating the input key throws a switch within the initiating dataconferencing appliance that causes it to begin an access negotiation procedure (hereinafter "negotiation procedure").
• the input key may be manually activated a second time to terminate the data communication session.
• the following example of the negotiation procedure involves initiation of the negotiation procedure at local site 102; it being understood that the negotiation procedure could, alternatively, be initiated from remote site 104.
• local and remote telephone adapters 140 and 142 include circuitry that generates audio signals (not shown) and transmits them within the voice call 148 in response to commands, which are issued by the negotiation procedure (step 220).
• the telephone adapters 140 and 142 also include circuitry for recognizing such audio signals when received via voice call 148. At least some of the audio signals transmitted in accordance with the negotiation procedure encode a network device access code.
• the network device access code may be any type of computer network address, data network address or code associated with local dataconferencing appliance 112 or with the dataconferencing session itself, such as, for example, a domain name, a URL, an IP address compliant with IPv4 or IPv6 (including IPv4 with CIDR), a virtual address (such as a multicast group address), a physical address (e.g., an Ethernet address or other MAC address), a session ID, or a passcode.
• the format for the address is predefined and commonly available to the negotiation procedures of the dataconference control units 128 and 130, and may include a 32-bit IPv4 address expressed as a series of 12 decimal digits, for example.
• Audio signals used for transmitting the network access code may include blank-and-burst techniques, DTMF tones, notch modem signals, and other types of electronically generated audio signals capable of transmitting data within an active voice call session with little or no interruption of the voice call and without terminating the voice call session.
• dataconferencing system 100 resumes the audio conference portion of the dataconference via voice call 148 (step 230).
• local and remote dataconferencing appliances 112 and 122 establish a data network session 160 over data network 132 via their respective network interface modules 134 and 136 (step 240), preferably using known Internet protocols.
• dataconferencing system 100 can transmit image data between local and remote sites 102 and 104 via data network session 160 (step 250) while the audio component of the dataconference is carried by voice call 148 (step 230).
• One preferred protocol for establishing data network session 160 involves the use of multicast group addressing ("multicasting").
• the network access code includes a single multicast group address that is selected from a range of available multicast group addresses reserved in accordance with IPv4 or IPv6 standards. Any device on the data network can join a multicast group and receive transmissions sent to the selected multicast group address.
• Multicasting is a group transmission model that restricts data transmission to only those parts of the data network where group members are located. It is useful for communication between two or more sites and has a benefit of avoiding problems associated with addressing of dataconferencing appliances that are hidden behind domain proxies or within corporate networks using DHCP.
• Multicasting reduces network traffic when sending data to multiple dataconference participants and facilitates transmission of images from any of the dataconference sites to all other participating sites.
• Multicast group address selection may involve the use of a multicast address dynamic client allocation protocol service ("MADCAP") accessible via the data network.
• MIDCAP multicast address dynamic client allocation protocol service
• a multicast group address may be selected at random by the initiating dataconferencing appliance, for example, by identifying an idle multicast group address using trial and error techniques. Other procedures may be possible for multicast group address selection. Because all dataconferencing appliances that join the multicast group are addressable at the same network address (i.e.
• the address negotiation procedure need involve only a single transmission of the commonly used multicast group address from the initiating dataconferencing appliance, via voice call 148, to distribute the network address to participating sites.
• the address negotiation procedure need involve only a single transmission of the commonly used multicast group address from the initiating dataconferencing appliance, via voice call 148, to distribute the network address to participating sites.
• all participating sites join the multicast group to establish a data connection therebetween via the data network.
• the access negotiation procedures of local and remote dataconferencing appliances 112 and 122 may also include security protocols that involve the exchange of encryption codes, either over data network 132 or voice network 146, or both, for enabling encrypted data communications between local and remote dataconferencing appliances 112 and 122.
• local and remote network interfaces 112 and 122 preferably include respective local and remote image processing subsystems 164 and 166 for compressing image data prior to transmission via data network session 160 and for decompressing image data upon receipt.
• compression of images may be performed in software or hardware at image source 116, with decompression being performed only at local and remote image processing subsystems 164 and 166 prior to delivery of substantially identical uncompressed images to the respective local and remote display devices 114 and 124 connected thereto.
• Image processing subsystems 164 and 166 may also perform image scaling for resizing images to fit the pixel resolution of the respective local and remote display devices 114 and 124 prior to delivery of the images.
• Local image processing subsystem 164 may include a frame buffer (not shown) for receiving frames of image data 188 from image source device 116 and for sensing changes in the image represented by image data 188.
• a change is sensed by local image processing subsystem 164, the current frame of image data 188 is processed for display on local display device 114 (step 270) and, separately, compressed for transmission within data network session 160.
• frame buffering and change detection is performed in software on image source device 116 to reduce the amount of data 188 transmitted between image source 116 and local dataconferencing appliance 112.
• local and remote dataconferencing appliances 112 and 122 are coupled to respective local and remote display devices 114 and 124 for exchanging control data (not shown) for controlling the images displayed, for reporting error conditions, and for communicating any other information useful for facilitating the dataconference.
• control data not shown
• the present invention allows images to be distributed and displayed "on-the-fly" nearly concurrently with their generation or playback at the image source. Distribution and display of images on-the-fly also reduces image data storage required at each participating dataconferencing site.
• Dataconferencing systems in accordance with the present invention can also be configured so that no residual image data is left at participating sites after termination of the dataconferencing session.
• FIGS. 3-12 are network diagrams showing several preferred and alternative dataconferencing system configurations, it being emphasized that the configurations shown in FIGS. 3-12 are exemplary only and not exhaustive of possible system and network configurations within the scope of the present invention.
• a dataconferencing system 300 in accordance with the first preferred embodiment 100 described above with reference to FIG. 1, includes at a local site 302 a local projector 308 (or other display device), a local speakerphone 312, and an image source 316, all connected to a simplified local dataconferencing appliance 322.
• Local dataconferencing appliance 322 includes a telephone adapter (not shown) for connecting to a voice network 330 and a network interface (not shown) for connecting to a data network 340, which is independent of voice network 330.
• Remote dataconferencing appliance 368 includes a telephone adapter and a network interface (not shown) for connecting remote dataconferencing appliance 368 to respective voice and data networks 330 and 340.
• Local and remote dataconferencing appliances 322 and 368 include respective pushbuttons 374 and 376 or other input key means for initiating a negotiation procedure implemented in software and/or hardware of appliances 322 and 368.
• Local and remote dataconferencing appliances 322 and 368 may be identical in all respects; however, in the embodiment 300 shown, remote dataconferencing appliance 368 need not include an interface for connecting an image source at remote site 352.
• a dataconferencing session is established using dataconferencing system 300 in accordance with the method described above with reference to FIG. 2.
• a voice call is first established between local and remote speakerphones 312 and 362.
• One of the local and remote dataconferencing appliances 322 and 368 is then activated by depressing one of the pushbuttons 374 and 376, which initiates negotiation procedures of the respective local and remote dataconferencing appliances 322 and 368.
• the negotiation procedures cause a network address to be encoded as electronically generated audio signals, which are transmitted between the respective local and remote dataconferencing appliances 322, 368 exclusively over voice network 330.
• local and remote dataconferencing appliances 322 and 368 use the network address establish a data network session therebetween via data network 340.
• local and remote projectors 402 and 406 at respective local and remote sites 410 and 412 include respective local and remote network interface modules 418 and 420 for connecting projectors 402 and 406 directly to data network 428.
• Local and remote dataconferencing appliances 436 and 438 each include a dataconference control unit and a telephone adapter (not shown) coupled to a voice network 444.
• Local and remote dataconferencing appliances 436 and 438 include pushbuttons 446 and 448, respectively, either one of which can be manually depressed to initiate negotiation procedures via voice network 444 for establishing a data networking session in accordance with the present invention.
• Local and remote speakerphones 456 and 458 are connected to respective local and remote dataconferencing appliances 436 and 438 in the same manner as first embodiment dataconferencing system 300 (FIG. 3).
• an image source 466 is connected to local dataconferencing appliance 436.
• the local and remote network interfaces 418 and 420 are integrated with or installed in respective local and remote projectors 402 and 406 for direct connection of the projectors 402 and 406 to data network 428.
• projectors 402 and 406 desirably have integrated image processing subsystems.
• all image transfer and display functions are handled by the projectors 402, 406 so that local and remote dataconferencing appliances 436 and 438 need only provide control unit functions, including initial dataconference negotiation procedures and any other interaction with voice network 444.
• FIG. 5 is a network diagram showing a third preferred embodiment dataconferencing system 500.
• dataconferencing system 500 includes, at respective local and remote sites 502 and 552, local and remote projectors 508 and 558, local and remote speakerphones 512 and 562, and local and remote dataconferencing appliances 522 and 568, all organized and connected to voice and data networks 530 and 540 in substantially the same configuration as first preferred embodiment dataconferencing system 300 (FIG. 3), except that an image source 580 is connected directly to local display device 508, rather than to the local dataconferencing appliance as in the system 300 of FIG. 3.
• this third preferred embodiment system 500 differs from that of the first preferred embodiment system 300 in that images generated by image source 580 are displayed by local display device 508 without prior image processing by an image processing subsystem of local dataconferencing appliance 522.
• the raw image data from image source 580 is used by local display device 508, which may have its own integrated image processing subsystem.
• Local dataconferencing appliance 522 receives image data from local display device 508 and compresses the image data before transmission via data network 540 for receipt by remote dataconferencing appliance 568.
• Remote dataconferencing appliance 568 includes an image processing subsystem for decompressing the received image before delivery of the image data to remote display device 558 for display, similar to the decompression step described above with respect to the first preferred embodiment dataconferencing system 300. [0067] FIG.
• FIG. 6 is a network diagram showing a fourth preferred embodiment dataconferencing system 600 for use at a local site 602 that does not have direct access to a data network, e.g., via an Ethernet junction or other digital data network access point.
• the network interface of a local dataconferencing appliance 620 includes a telephone modem 624.
• Modem 624 is configured to indirectly access data network via an Internet service provider ("ISP") 630, with which modem 624 establishes a modem communication session via a voice network 640.
• ISP Internet service provider
• modem 624 may be configured to automatically dial and log on with ISP 630 for accessing a data network 610 when a pushbutton 644 of local dataconferencing appliance 620 is depressed.
• Modem 624 may be a conventional voice call modem utilizing, for example, N.90 protocol, in which case two telephone lines would be required, a first line 660 for modem 624 and a second line 662 for the voice call session between a local speakerphone 648 and a remote speakerphone 678.
• modem 624 may be a DSP modem (not shown), in which case it could use the same telephone line at local site 602 as that used by local speakerphone 648.
• the voice call session and the data network session are able to share a single copper telephone line at local site 602 because DSP modems transmit data in a different frequency band from that used by a telephone.
• Fourth preferred embodiment dataconferencing system 600 illustrates a distinction between voice and data networks of the type used in the present invention.
• the networks can share physical equipment, but a voice call and a data network session are separate and not interlinked. Consequently, signals of the voice call do not affect the data network session or any associated data network services and, conversely, the signals transmitted in the data network session do not affect the voice call or any associated voice network services.
• convergence occurring in modern data networking and voice telecommunications technology is blurring the historically distinguishable features, protocols, and equipment used with voice and data networks. Nevertheless, those skilled in the art will also appreciate that methods of establishing a voice call are different from uiose used to establish a data networking session, regardless of the physical network equipment and communications media employed for such purposes.
• a telephone receiver such as a conference room speakerphone
• data network addresses may be dynamically assigned and are not generally indexed in a manner meaningful to the typical dataconference participant.
• Dataconference control units in accordance with the present invention are configured to automatically obtain a network access code and to automatically transmit signals in the voice call using an access negotiation procedure to send appropriate access codes to one or more dataconference control units at geographically remote sites.
• Some embodiments of the negotiation procedure of the present invention involve exchanging the network addresses of the respective network interface modules.
• other embodiments involve transmission of a multicast group address or a network address or passcode of a centralized conference service that is located, for example, on the World Wide Web.
• the invention eliminates the need for conference participants to input network address information into the dataconferencing system when establishing a dataconferencing session.
• only one participant need take any action to activate the system, viz, by depressing a key on the participant's dataconferencing appliance or on any other component of the system.
• other embodiments would require all users to depress or otherwise activate the key before joining the data portion of the dataconference, which could provide enhanced system security.
• FIG. 7 is a network diagram showing a fifth preferred embodiment dataconferencing system 700 in which a local dataconferencing appliance 710 includes wireless networking equipment (not shown) for communicating with a similarly equipped image source 720 and a similarly equipped display device 730 at a local site 732.
• a remote site 740 a remote display device 744, a remote dataconferencing appliance 748, and a remote speakerphone 752 are connected to respective voice and data networks 760 and 762 in the same manner as the corresponding system components of second preferred embodiment system 400 (FIG. 4).
• Any of various wireless networking technologies can be employed for the wireless networking equipment of local dataconferencing appliance 710, image source 720, and local display device 730.
• equipment operating in accordance with the IEEE 802.11 standards may be used.
• Alternative wireless network technologies useful with the present invention include Home RF, infrared networking, and any other short- and long-range wireless networking systems and devices, including short- range peer-to-peer wireless networking such as BLUETOOTH. Skilled persons will appreciate, however, that the data transfer rates supported by the different wireless networking technologies will affect the performance of the system and may necessitate additional steps of image data compression and decompression for efficient wireless transmission between the components of system 700.
• FIG. 8 is a network diagram of the dataconferencing system of FIG. 7 in which local dataconferencing appliance 810 further includes wireless LAN hardware 804 for communication with an infrastructure wireless networking access point 820 coupled to a data network 830.
• local dataconferencing appliance 810 further includes wireless LAN hardware 804 for communication with an infrastructure wireless networking access point 820 coupled to a data network 830.
• Skilled persons will understand that numerous other variations on wireline and wireless networking connections can be employed in accordance with the present invention.
• the specific combinations of wired and wireless networking shown in FIGS. 7 and 8 are exemplary only and should not be construed as limiting the extent to which wired or wireless networking may be used with dataconferencing appliances and dataconferencing system components embodying the present invention.
• any of the network connections shown by solid lines connecting components of the dataconferencing system of FIGS. 3-12 can be replaced with wireless links for transmitting data or audio-bearing signals.
• FIG. 9 depicts a network diagram of a dataconferencing system arrangement 900 employing local and remote computer workstations 902 and 904 as image sources located at respective local and remote sites 910 and 912.
• Local and remote computer workstations 902 and 904 execute multi-source presentation management software for facilitating presentation of visual images.
• local and remotely sourced image content may be presented in a side-by-side manner in split-screen displays 920 and 922.
• images can be shown as picture-in-picture, alternated, rotated, or tiled at the user's direction or by other criteria.
• Local and remote dataconferencing appliances 930 and 932 are configured to sense when more than one source of image data is connected thereto (including indirect connections via data network 940) and to accommodate the display of multiple images.
• Alternative embodiments of the invention (not shown) accommodate the display of more than one image source across the data network, display of images from multiple image sources directly connected to a single dataconferencing appliance, and the use of multiple dataconferencing appliances at a site.
• FIG. 10 is a network diagram showing yet another embodiment of a dataconferencing system 1000 in accordance with the present invention.
• dataconferencing system 1000 includes, at each of a local and remote site 1002 and 1004, local and remote integrated dataconferencing speakerphone appliances 1010 and 1012, respectively, which are described in more detail below with reference to FIGS. 13 and 14.
• Integrated dataconferencing speakerphone appliances 1010 and 1012 perform the functions of both the simplified dataconferencing appliance and the speakerphone of the previously described embodiments of FIGS. 3-9.
• integrated dataconferencing speakerphone appliances 1010 and 1012 are intended to be placed on a work surface such as a conference table to provide convenient tabletop access to data and voice networks 1020 and 1030.
• local and remote integrated dataconferencing speakerphone appliances 1010 and 1012 may also serve as wireless networking access points or hubs when equipped with wireless networking hardware.
• FIG. 11 is a network diagram showing still another preferred embodiment of a dataconferencing system 1100 including an integrated dataconferencing projector appliance 1111 having an integrated speakerphone 1116, a telephone keypad 1118, and a projection display device 1120.
• Integrated dataconferencing projector appliance 1111 also includes an integrated network interface module (not shown), a pushbutton 1122 for activating an integrated dataconference control unit (not shown), and connectors (not shown) for connecting to voice and data networks 1130 and 1140.
• integration of projection display device 1120 in dataconferencing projector appliance 1111 improves portability of the dataconferencing system and simplifies setup at conference sites. However, many users may prefer to keep a projection-type display device separate from the other system components (as in the dataconferencing systems of FIGS.
• the projection display device can be positioned to enhance the quality of the image displayed, e.g., by locating the display device on the ceiling of the conference room while allowing the speakerphone and dataconference control unit to be placed at a conference table for easy access by participants.
• FIG. 12 is a network diagram showing a dataconference system 1200 linking five conference sites in a five-way dataconference in accordance with the present invention.
• the number of dataconferencing sites that can be accommodated by a system in accordance with the present invention is limited only by the speed and capacity of the system and network components.
• the present invention is capable of establishing a dataconferencing session between a very large number of participating dataconference sites— possibly hundreds or even thousands of sites. Skilled persons will recognize that conference bridge equipment would be necessary to support the audio conference portion of a dataconference among large numbers of participants, due to attenuation produced by less sophisticated conference calling equipment and techniques.
• dataconferencing system 1200 links first, second, third, fourth, and fifth dataconferencing sites, 1201, 1202, 1203, 1204, and 1205, respectively, via independent voice and data networks 1210 and 1212.
• data network connections 1220 between dataconferencing sites 1201-1205 and data network 1212 is indirect, as described with reference to FIG. 6.
• indirect connections e.g., modem connections, comprising segments of data network 1212 are within the scope of the present invention.
• none of the connections of dataconferencing system 1200 is shown as a wireless connection.
• wireless networking connections could easily be utilized at any of the sites 1201-1205 or in place of any of the data network connections 1220 of dataconferencing system 1200.
• first dataconferencing site 1201 a conventional speakerphone 1242 and a projector 1244 are connected to a first simplified dataconferencing appliance 1246 of the type described above with reference to FIGS. 3-9.
• Hardware and/or software of dataconferencing appliance 1246 comprise a network interface module, a dataconference control unit, and an image processing subsystem.
• Dataconferencing appliance 1246 is connected to voice network 1210 and separately to data network 1212.
• a network enabled projector 1252 includes a network interface module 1254 for communication with data network 1212.
• Projector 1252 is connected to a dataconferencing speakerphone appliance 1256 having an integrated dataconference control unit and speakerphone, which are connected to voice network 1210.
• Third dataconferencing site 1203 includes only a speakerphone 1258 connected to voice network 1210 for participation in the audio portion of dataconferences but not the visual component of dataconferences.
• a computer workstation 1262 includes a display device 1264 and an image processing subsystem, along with optional presentation software for serving as an image source and for coordinating multisource presentations.
• a network interface module (not shown) of computer workstation 1262 connects computer workstation 1262 to data network 1212.
• Computer workstation 1262 is also connected to a simplified dataconferencing appliance 1268, which includes a dataconference control unit and a telephone adapter (not shown) in accordance with the present invention.
• Dataconferencing appliance 1268 is connected to voice network 1210 for exchanging network access codes with first, second, and fifth sites 1201, 1202, and 1205 via signaling within a voice call on voice network 1210.
• a telephone set 1270 is connected to dataconferencing appliance 1268 to allow a person at fourth site 1204 to participate in the audio component of dataconferences.
• a dataconferencing computer workstation 1280 includes a video display monitor 1282, a microphone 1284, and a loudspeaker 1286.
• Dataconferencing computer workstation 1280 includes a network interface module (not shown) for connection to data network 1212 and a sound card, a telephone adapter, or other hardware (not shown) for connection to voice network 1210.
• Software executing on dataconferencing computer workstation 1280 handles incoming and outgoing telephone calls and can perform all of the functions of a telephone receiver, a dataconferencing appliance, an image source, and an image processing subsystem within the scope of the present invention.
• dataconferencing computer workstation 1280 is similar to fully integrated dataconferencing appliance 1111 of FIG.
• FIG. 13 is a pictorial view of the integrated dataconferencing speakerphone appliance 1010 of FIG. 10.
• dataconferencing speakerphone appliance 1010 includes a housing 1302 that holds a speakerphone including a loudspeaker 1304 and a touchpad 1306 for dialing the speakerphone.
• a voice call is established on the voice network by dialing a telephone number of a remote site using touchpad 1306.
• a speakerphone ON/OFF button 1314 controls the on-hook or off-hook status of the speakerphone when initiating or ending a voice call session.
• Dataconferencing speakerphone appliance 1010 also includes an integrated network interface module, a dataconference control unit, and a telephone adapter (not shown) connected to a voice network via a telephone line 1310.
• the dataconference control unit includes a digital processor and other circuitry or software that is designed to control the telephone adapter for sending electronically generated audio signals within the voice call.
• Dataconferencing speakerphone appliance 1010 includes a PC-video-IN connector 1318 for connecting a video image source device such as a personal computer 1420 (FIG. 14); one or more USB slots 1322 for connecting peripheral devices such as keyboards, digitizing tablets, and image source devices; and, optionally, a wireless LAN card 1328 and a wireless input device receiver (not shown) for connecting, respectively, to a data network via a infrastructure wireless networking access point (not shown) and to an input device such as a wireless keyboard.
• a DNI or USB cable 1334 connects dataconferencing speakerphone appliance 1010 to a projector or other display device (not shown).
• An optional network cable 1338 connects the network interface module of dataconferencing speakerphone appliance 1010 to an external data network.
• One or more RJ-45 connectors 1342 are available for connecting an image source or other network-enabled devices to the data network.
• a power cable 1346 is connected to a 110-volt AC power supply or wall socket to supply power to dataconferencing speakerphone appliance 1010.
• a pushbutton 1350 is provided for activating the dataconference control unit to perform the access negotiation procedures and voice-call signaling methods in accordance with the present invention.
• dataconferencing speakerphone appliance 1010 An additional benefit provided by dataconferencing speakerphone appliance 1010 is the convenient tabletop connectivity to display device(s) and to voice and data networks afforded by integrating the various connectors and cables into a single unit. Thus dataconferencing speakerphone appliance 1010 is useful as a convenient means of connecting a presenter's computer (or other image source) to the display device and/or the data network, even if dataconferencing functions are not utilized.
• FIG. 14 is a pictorial view the dataconferencing speakerphone appliance 1010 of FIG. 13 showing details of the appliance 1010.
• RJ-45 connectors 1342 and PC-video-IN connector 1318 are attached to cables 1410, 1412 that retract within housing 1302 when not in use and extend from the dataconferencing speakerphone appliance 1010 when needed for connection to a computer 1420 or another network-enabled device or image source.
• FIG. 15 is a state diagram depicting steps in an embodiment of an address exchange procedure 1500 (negotiation procedure) of a dataconferencing appliance operating in accordance with the present invention.
• the dataconferencing appliance emulates ringing (2) when a ring signal 1504 is received via the voice network, thereby causing an attached telephone receiver to ring.
• a pushbutton or other input key of the dataconferencing appliance is manually activated 1510 to cause the dataconferencing appliance to transmit a "0" DTMF tone and to listen for a reply 1516. Otherwise, the dataconferencing appliance listens for a "0" DTMF tone 1522.
• the remote dataconferencing appliance mutes its attached telephone receiver and replies with 12 DTMF tones representing its IPv4 decimal address 1530.
• the local dataconferencing appliance completes the exchange procedure by replying to the remote data conferencing unit with the 12 digit IPv4 decimal address of the local dataconferencing appliance, which is also represented by 12 DTMF tones 1534.
• an LED on dataconferencing appliance is lit to indicate that a data network session has been established 1540.
• negotiation procedure 1500 may involve the transmission of only one rather than both IP addresses, for example when using multicast addressing, as described above with reference to FIG. 2.
• an alternative address exchange procedure (not shown) could use other types of electronically generated audio signals. Error checking and error correction could also be included in negotiation procedure 1500.
• FIG. 16 is a block diagram of an alternative embodiment dataconferencing system 1600 deploying the present invention across a computer network firewall.
• dataconferencing system 1600 is organized for communication between a local site 1602 and a remote site 1604.
• Local site 1602 includes a firewall 1610, which is installed at local site 1602 between a local dataconferencing appliance 1616 and a data network 1620, which is external to local site 1602.
• Firewall 1610 acts as a gateway to prevent any unauthorized network traffic from entering a LAN at local site 1602 using methods known in the art.
• a remote dataconferencing appliance 1626 is located at remote site 1604 and may be identical to local dataconferencing appliance 1616 or configured differently.
• an Internet conference server (“ICS") 1630 is coupled to data network 1620 and made accessible to local and remote dataconferencing appliances 1616, 1626 via data network 1620.
• ICS 1630 serves as a repository for commands and data to be transferred over data network 1620 between local and remote sites 1602 and 1604.
• dataconferencing appliances 1616, 1626 may transmit electronically generated audio signals (not shown) over a voice network 1640 when data, images, or commands are waiting at ICS 1630 for pick-up by the other dataconferencing appliance.
• dataconferencing appliances 1616, 1626 may periodically poll ICS 1630 to determine whether new data or commands are available at ICS 1630.
• a network address of ICS 1630 is stored in memory on local dataconferencing appliance 1616.
• the network address of ICS 1630 is preferably stored on all dataconferencing appliances at the time of their manufacture.
• a participant at local site 1602 establishes a voice call between local and remote speakerphones 1652 and 1654 and manually activates local dataconferencing appliance 1616 to send a request to ICS 1630 via data network 1620.
• ICS 1630 launches a dataconferencing session process, allocates memory, assigns a dataconferencing session ID, and replies to local dataconferencing appliance 1616 with the session ID (or passcode) and an encryption key for secure communications.
• firewall 1610 will allow the reply to pass to local dataconferencing appliance 1616.
• local dataconferencing appliance 1616 Upon receipt of the reply from ICS 1630, local dataconferencing appliance 1616 causes audio signals representing the session ID (passcode) to be transmitted via voice network 1640 within the voice call for receipt by remote dataconferencing appliance 1626.
• remote dataconferencing appliance 1626 uses the passcode to establish secure communication with ICS 1630, which thereafter serves as a mailbox for exchanging data and/or commands between local and remote dataconferencing appliances 1616, 1626.
• dataconferencing system 1600 operates in the same manner as dataconferencing system 100 of FIG. 1 and using the method 200 described above with reference to FIG. 2.

Priority Applications (4)

Applications Claiming Priority (6)

Publications (1)

Family

ID=27366361

Family Applications (1)

Country Status (6)

Cited By (25)

Families Citing this family (6)

Citations (3)

Family Cites Families (5)

• 2002
  • 2002-09-27 JP JP2003536896A patent/JP4176637B2/ja not_active Expired - Fee Related
  • 2002-09-27 KR KR1020047005682A patent/KR100944208B1/ko not_active IP Right Cessation
  • 2002-09-27 EP EP02773634A patent/EP1436707A4/en not_active Withdrawn
  • 2002-09-27 WO PCT/US2002/030848 patent/WO2003034235A1/en active Application Filing
  • 2002-09-27 CN CNB028252772A patent/CN100354841C/zh not_active Expired - Fee Related
• 2005
  • 2005-08-23 HK HK05107390A patent/HK1075104A1/xx not_active IP Right Cessation

Patent Citations (3)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events