INTEGRATED CONTROL CENTER ENVIRONMENT
TECHNICAL FIELD
The present invention relates generally to the field of control centers for complex networks and more particularly to an integrated control center environment.
BACKGROUND ART
Control centers for complex networks such as telecommunication systems (network operations centers or NOCs), satellite systems, power utilities transportation and broadcast networks often combine information technology, audiovisual technology and control information. Unfortunately, present control center systems treat each of these areas completely separately. This results in separate cabling for each of these areas. In addition, control center operators who are remote from the devices of the control center can commonly only control or monitor one device at a time. This results in increased labor cost and boredom on the part of the operator. Multiple proprietary systems also result in clutter, increasing confusion and diminishing efficiency within the control room. There is also a need for low cost application of control center functions in residences that now typically share many of these same types of inputs, such as security devices, cable TV and data connections, HVAC, phone lines, DVD, VCR, radio and the like.
Thus there exists a need for an integrated control center environment that reduces cabling costs, integrates the information technology, audiovisual technology and control information for home or business applications.
The present invention is intended to overcome one or more of the problems discussed above.
SUMMARY OF THE INVENTION
An integrated control center environment includes a switch. The switch is connected to a control station. A plurality of computers and audiovisual equipment is also connected to the switch. A workstation capable of multiple progressive scan inputs is connected to the switch and one of the plurality of computers. A device controller is connected to the audiovisual equipment. A server is connected to and controls the
switch. A network and/or serial communication connects the server, the plurality of computers, the device controller and the workstation. The switch and the server allow a control station to view the output from any of the plurality of computers or the audiovisual equipment. In addition, the switch and the server allows control signals to be sent to any of the plurality of computers or audiovisual equipment from the control station. The multiple progressive scan workstation allows the control station to view and control multiple computers and/or audiovisual equipment simultaneously, for example 16 or more input windows on a high resolution monitor. The system operates multiple distinct computer systems, video devices, audio/video and multimedia on a single platform, using one or more monitors, one keyboard and one mouse. In addition, the source devices (e.g., audio/video, multimedia, computers) may be located in a secure location away from the control station. This system reduces cabling by having a switching system that can switch audio, video, computer information and control information. The integrated system allows the control operator to both view and control multiple computers or audiovisual equipment simultaneously.
BRIEF DESCRIPTION OF THE DRAWINGS
Fig 1 is a high level functional diagram of the present invention; Fig. 2 is an exemplary monitor display;
Fig. 3 is a high level block diagram of an embodiment of the present invention;
Fig. 4 is a more detailed block diagram of an embodiment of the present invention;
Fig. 5 is a block diagram of the overlay processor of the present invention;
Fig. 6 is an exemplary display from a three-monitor control console of the present invention; and
Fig. 7 is a diagram of an exemplary control system environment in which the present invention is incorporated.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
SYSTEM ARCHITECTURE AND FUNCTIONAL OVERVIEW
Fig 1 is a high level function diagram of the control system environment 100 of the present invention. The environment 100 includes one or more source devices 102,
such as information technology ("IT") sources 104, such as computers, one or more audio/video ("AV") sources 106 , such as DVD players, one or more video-only sources 108, such as video cameras, and one or more audio-only source 110, such as microphones. It will be appreciated that not all of such exemplary sources need be present in the environment 100. All of such sources (referred to herein as "source devices") have keyboard, video, mouse and/or audio ("KVMA") inputs or outputs which (directly or indirectly) are input to or output from a distribution component 112. Additionally, the environment 100 may include other devices 114 (hereinafter "non- source devices"), such as security alarm systems, access control systems, environmental control systems and the like, which do not generate or receive KVMA signals and are not interconnected with the distribution device 112. The environment further includes one or more destination devices 116, such as video destinations 118, such as display monitors and video projectors, audio destinations 120, such as speakers, and console destinations 122, which may include keyboard, monitor, mouse and speakers. It should be noted that the term "mouse" will be used generically herein to include any computer cursor or pointer control device, including a mouse, trackball, touchpad, Trackpoint®, among others. The destination devices 116 have KVMA inputs or outputs which (directly or indirectly) are input to or output from the distribution component 112. A systems management component 124 provides control functions for the destination devices 116, and, through a system control component 126, the non-source devices and the audio/video, video-only and audio-only sources 106, 108 and 110. As will be described in detail below, an optional overlay component 128 may be included in the control environment 100. In operation, the systems management component 124, in response to commands from an operator at a control console 122, directs the distribution component 112 to connect any one or more of the source and non-source devices 102 and 114 with any of the destination devices 116. Consequently, for example, any of the video destinations 118 may monitor any of the video sources 108. By way of an additional example, any one of the control consoles 122 may monitor and control any of the IT sources 104. And, non-source devices 114 may be monitored indirectly and, where appropriate, controlled by an operator at a control console 122. As illustrated in Fig. 2, the overlay component 128 permits multiple source and non-source devices 102
and 114 to be displayed in multiple windows or "viewports" on a single video destination 118. In Fig. 2, four viewports 202-208 are visible within a primary display 200, each displaying a different source or non-source device.
HARDWARE OVERVIEW
Fig. 3 is a block diagram of an integrated control center environment 300. A signal distribution device 302 interconnects a variety of IT (computer) and audiovisual equipment with control processors and consoles. The distribution device 302 is preferably an analog KVAM (keyboard, video, mouse, audio) switch which can distribute KVMA signals among various input and output ports. However, the distribution device 302 may alternatively be a digital router having a similar function or may comprise more than one switch or router, according to the source and destination devices to which it is interconnected. For purposes of simplicity, the term "switch" will be used generically in the present application to include analog switches and digital routers, alone or in combination. A representative source of KVMA switches is C-C-C Network Systems.
A plurality of control computers or processors 304 are connected to a source side source port 306of the switch 302 and one or more control stations or consoles 308 are connected to a destination side of the switch 302. A control console 800 includes at least one video display device, a mouse, preferably a keyboard and optionally, speakers. Although a keyboard is not a necessary component of the control console and an operator may be able to exercise control using only a mouse to execute "point and click" operations, a keyboard provides added ease and flexibility and is, therefore, preferred. The connections between destination ports 308 on the switch 302 and the control console 800 include mouse and, preferably, keyboard connections to permit the operator to enter control commands. The connections between the switch 302 and a control console 800 also include video and, optionally, audio, connections to permit the operator to monitor source devices. As will be described more thoroughly below, the switch 302 is able to be commanded to interconnect any of the control processors 304 with any of the control consoles 800.
One or more source devices 900 are connected through source ports 310 to the switch 302. Source devices may include computers (also referred to as "IT sources")
and audio, video or audio/video equipment (also referred to collectively as "A/V sources"), interconnecting with the switch 302 through KVM and/or A source ports. Again, as will be described more thoroughly below, the switch 302 is able to be commanded to interconnect any of the source devices 900 with any of the control consoles 800.
Optionally, one or more other devices 1000 (referred to as "non-source devices" because, although they pertain to the source side of the switch 302, they are not actually interconnected with the switch 302) may be included in the control environment 300. As noted above, such devices may include environmental control systems (such as HVAC and lighting systems), facility access systems and security systems). Non-source devices 1000 may be interconnected with control processors 304 through a network 312 (local, remote, or internet) thereby permitting an operator at a console 800 to monitor the status of a non-source device 1000. Also optionally, an overlay processor 500 may be interconnected with the switch 302 through a source port 314 and be interconnected with a console processor 304, directly or through the network 318. The overlay processor 500 may be incorporated into a console processor 304 or be a separate unit. The overlay processor 500 permits multiple viewports to be displayed on a display monitor, thereby allowing the operator to monitor and control multiple source and non-source devices. Although it is preferable that a switch be employed in the present invention, it is not a necessary component. The source devices and control consoles may instead be interconnected through a console processor. For a relatively small installation, such an arrangement may be a satisfactory and cost-effective solution; for larger installations; however, inclusion of a switch is the preferred embodiment.
HARDWARE DETAILS
Fig. 4 is a more detailed block diagram of the control environment 300 in which the present invention is incorporated. One or more console stations 800 are interconnected with the switch 302. A console 800 includes a principal display unit
802, a mouse 304, preferably a keyboard 306 and, optionally, speakers 308. One or more secondary display units 810 and 812 may also be included in the console 800 to permit the operator to monitor and control additional source and non-source
devices. Other display units 402, including flat screen displays, and video projectors 404 may also be interconnected with the switch 302. A typical analog switch may not have the capability to manage KVMA signals directly from KVMA sources. Consequently, converters or "extenders" may be employed between a destination device and a destination port on the switch 302. For example, video extenders 406 may be used in conjunction with the display units 810, 812, 406 and 404 while a complete KVMA extender 408 may be used in conjunction with each control console 800. An audio extender (not shown in Fig. 4 on the destination side of the switch 302) may used to connect independent speakers (not associated with a console 800) to the switch 302 if it is desired to monitor an audio source.
To the source side of the switch 302 are connected one or more console control processors 304. The control processors 304 may be from a variety of different manufactures and running a variety of different operating systems, for example Hewlett Packard, Sun, SGI or Intel-based PCs running Windows, Solaris, Unix or other operating systems. The control processors 304 may be interconnected with the switch 302 through KVMA extenders 410 (when necessary) whereby keyboard and mouse signals are routed from a control console 800 through the switch 302 to a console processor 304 and video and audio signals are routed from a console processor 304 through the switch 302 to a console 800. Both the switch 302 and the control processors 304 are coupled with a network 410 (the switch 302 having a network interface through a device server 412). Thus, an operator at a console 800 may, through a console processor 304, direct the distribution matrix of the switch 302 and allow selected source and non-source devices to be monitored at the console 800. One or more computer or IT sources 902 may also be connected to the source side of the switch 302; any of the IT sources 902 may be connected to one or more networks, such as a local area network (LAN) 904, different from the control network 410. As with the control processors, the IT sources 902 may be from a variety of different manufactures and running a variety of different operating systems. Similarly, connections with the switch may include KVMA extenders. The IT sources 902 may control or monitor an external device or simply process data. A variety of audio/visual equipment 906 may also be connected to the switch 302 using video and/or audio extenders. The audiovisual equipment may include DVDs
(digital video disks), VCRs, satellite or cable television, radio tuners, security cameras, etc. Because most audio/visual equipment is not designed to connect to a local area network, a device controller and processor 908 interfaces audiovisual equipment 906 with the control network 410. Thus, a user at a console 800 may control the A/V equipment 906. Exemplary controls may include (but are not limited to): playback, rewind, fast-forward, etc. in the case of a DVD or VCR; pan, tilt, zoom and focus in the case of a video camera; and channel, volume, etc. in the case of television, Illustrative sources for the device controller 908 are Creston and Panja. In a preferred embodiment, a server 414 controls the switch 302 and is connected to the control processors 304 and device controllers 908 through the control network
410. Because currently available "off the shelf KVMA switches allow only one source to be displayed by one of many displays, the server 412 runs control software which allows the switch 302 to make one-to-one, one-to-many, many-to-one and many-to- many connections simultaneously. In essence, the software commands the conventional KVMA circuitry to allow multiple sources to be displayed or played on multiple display devices, which could include video displays of multiple control stations. As a result, a control console 800 may be connected to several source devices 900 simultaneously and other control consoles may also view or monitor the same devices 900 simultaneously. In addition, the control software allows a control 800 to display and control the various source devices 900 connected to the switch
302. The control software preferably allows only a single control console 800 to control a particular device at a time. The control software also causes display of configurable control banners for implementing control software functions, such as stored screen "window" configurations. The server 414 preferably also includes a variety of security measures to limit access to various source devices 902. An operator logs onto the system (through a console processor 304 to the server 414) and provides a password or other identification. A system administrator may define the access allowed to each operator. In one embodiment, each operator is assigned a class of access (e.g. unlimited, confidential, secret, top secret). The server stores operator IDs and associated access levels in a database. Other information may also be stored in the database, such as IP (Internet Protocol) addresses, MAC (Media Access Control) numbers, process IDs,
etc. related to control processors 304 and source and non-source devices 900 and 1000.
Although the functions of the server 414 may be performed by software running on a console processor 304, it is preferred to employ a dedicated server 414. As noted previously, the switch 302 may be one or more analog switches, one or more digital routers, or any combination of units. An switch connects and distributes analog signals while a router performs the same function for digital signals. A router greatly increases the scalability of the system. It will be appreciated that, while the control consoles 800, control processors 304, IT sources 904, audio/visual sources 906 and non-source devices 1000 are illustrated with a local area network connection (the control network 410), any or all of the devices may be connected remotely. A remote connection may require special cabling, possibly with boosters. Alternatively, modems may be used to send the information over phone lines. Information may also be sent over the internet. Yet another solution is to digitize the information and send it over a packet network.
An overlay processor 500 may optionally be employed in the control environment 300. The overlay processor 500 may be incorporated into the server 414, a control processor 304 or may be a separate unit in communication with the control processors 304 and the switch 302 through the control network 410. The overlay processor 500 allows a control console 800 to view multiple windows or viewports from any of the audio/visual devices 906 and/or any of the displays of control processors 902 simultaneously on a single display device, such as the display 802. Representative sources of analog overlay processors, that is composite video devices, include Miranda, RGB Spectrum and Folsom. In addition to display, a control console 800 may also access control windows displayed at the console in order to control operation of these source devices 900 and non-source devices 1000. When a video router is used instead of an analog switch, the overlay processor 500 may be a frame buffer and processor residing in one of the control processors 304. Fig. 5 schematically illustrates the functional interconnections of the overlay processor 500 with other components of the control environment 300. The video processor 500 has a primary video input 502, a plurality of secondary video inputs 504, a control input 506, and a combined video output 508. The master video input 502 and the control input 506 are interconnected with a video output 304A and a control output
304B, respectively, of a control processor 304. The secondary video inputs 504 are interconnected with destination ports 302A of the switch 302 through video extenders 406. It will be appreciated that if the switch 302 is a digital router, other interconnections may be necessary between the switch 302 and the overlay processor 500. As previously noted, the control processor 304 also includes keyboard, mouse and audio outputs 304C which are interconnected with corresponding inputs to a KVMA extender 410. Combined video output 508 of the overlay processor 500 is also interconnected with the video input to the KVMA extender 408. The output of the KVMA extender 410 is interconnected with one of the source ports 302B of the switch 302. Other video sources are also interconnected with source ports 302B and display devices, such as the display monitor 802, are also interconnected with destination ports 302A through an extender, such as KVMA extender 408. In operation, an operator at the console 800, after logging on to the system, will be connected with the control processor 304 through the switch 302 as if directly connected to the control processor 304. The operator views the monitor 802 which displays primary window based on whatever operating system is running on the control processor 304. The operator may then command the control processor 304 to direct the switch 302 to "engage" the overlay processor 500; the primary video signal from the control console 304 is thus sent to the overlay processor 500, the output of which is sent through the switch 302 to the monitor 802 of the control console 800. By executing other commands from the console 800, the operator may then direct the console processor 304 to direct the switch 302 to transfer video signal from selected video sources, connected to the switch through source ports 302B, to secondary video inputs 504 of the overlay processor 500. These signals are "overlaid" onto the primary video signal in a window-within-a-window manner and the combined signal output from the overlay processor 500 through the output 508 and, through the switch 302, displayed on the monitor 802 (or on any other selected monitor). Thus, the secondary inputs 504 to the overlay processor 500 are processed as any other video destination and the output 508 is processed as any other video source.
Referring again to Fig. 2, the exemplary control console display 802 is divided into four viewports (windows) 202-208 within the larger, primary display window 200. However, the present embodiment contemplates up to sixteen viewports being
simultaneously displayed. Future embodiments may include more than sixteen windows. The mouse 304 may be used to initiate control functions of the system by means of the tool bar 210 at the top of the primary display window 200. The mouse 304 may also be used to control various devices associated with the displays through familiar "windows" based controls, as illustrated in the lower left viewport 206. As indicted in the lower right viewport 204, direct video feeds may also be displayed in a viewport. There is little or no degradation due to the number of viewports or sources being displayed. Fig. 6 illustrates an exemplary console configuration, consisting of three video monitors 802, 810 and 812, a keyboard 306, a mouse 304 and speakers 308 (it will be remembered that the use of a keyboard is not essential; however it is preferred).
The center monitor 802 is supported as a multiple window display, such as described above with respect to Fig. 2. The monitors 810 and 812 on the left and the right each support a single input source (although they, too, could be configured to display multiple sources). The system allows the operator to cue up multiple source systems in defined priority sequences to control many information sources at one time. The system also allows the operator to predefine configurations and cause them to be enabled with a single key (known as a "sweet key"), similar in nature to a script or macro. Thus there has been described an integrated control center environment which: 1 ) reduces the amount cabling costs in a control center; 2) integrates the information technology, audiovisual and control stations and 3) increases the control operator's efficiency. These benefits are provided by an integrated switch which can handle any of the various signals in the control center. The switch is further enhanced by software which allows the switch to connect many inputs to many outputs simultaneously. Control software for the switch and the control stations allows an operator at each station to view multiple devices on one screen, alone or simultaneously. In addition, a control station can control one or more of these devices. The methods described herein may be implemented as computer-readable instructions stored on a computer-readable storage medium which, when executed by a computer, will perform the methods described herein.
EXAMPLE
Fig. 7 is a high level illustration of an exemplary control environment 700 in which the present invention is incorporated. The environment 700 illustrated includes a server room 710, a control center operations floor 720, a conference center 730 and a security and facilities control system 740. The control center operations floor 720, the conference center 730 and the security/facilities system 740 are interconnected with the server room 710 through various interconnections discussed above. The server room 710 (which, of course, need not be a single room or even a single location) includes an administrator's control console 712, various servers and control processors 714, which may be from different manufacturers and running different operating systems, and various audio/video equipment 716. The control center operations floor 720 includes a manager's console 722, several operator's consoles 724, and various large-scale video displays 726. The conference center 730 includes a control console 732, a video wall 734 and audio/video equipment 736. And, the security/facilities system 740 includes a console 742, audio/video equipment 744 for monitoring facilities, and a video display 746 and is interconnected with various security devices (such as, by way of example and not limitation, perimeter contacts, infrared area sensors, HVAC sensors and control devices, lighting controls, etc.).
A system administrator would be present at the administrator console 712 to monitor all activities of the environment 700, having the ability to interconnect with any control processor or server 714, any console 722, 724, 732 or 742 on the operations floor 720, in the conference center 730 or securities/facilities system 740 and with any source or non-source device in the system. A floor manager at the manager's console 722 would have the ability to monitor the consoles 724 on the operations floor and any source and non-source devices to which they are interconnected (which may include the conference center 732). It would be preferable for security reasons that access to the security/facilities operation 740 be limited to the operator at the console 742 and the administrator at the administrator's console 712. It will be appreciated that other control environments may be installed with other configurations. For example, an airport may include additional security equipment, baggage and people x-ray
machines, perimeter cameras, cameras throughout the airport with the ability to track selected individuals, two way radios associated with security personnel, etc. A power plant environment may include equipment monitoring sensors. The objects of the invention have been fully realized through the embodiments disclosed herein. Those skilled in the art will appreciate that the various aspects of the invention may be achieved through different embodiments without departing from the essential function of the invention. For example, the server (or a control console) may monitor the status of non-source devices and automatically activate predefined responses when particular events are detected. Such events could include a security perimeter incursion switch being activated and a response could be internal doors being closed and locked along with a message being sent to an operator. The particular embodiments are illustrative and not meant to limit the scope of the invention as set forth in the following claims.