CA2237654A1 - Input device for use with digital networks - Google Patents

Input device for use with digital networks Download PDF

Info

Publication number
CA2237654A1
CA2237654A1 CA002237654A CA2237654A CA2237654A1 CA 2237654 A1 CA2237654 A1 CA 2237654A1 CA 002237654 A CA002237654 A CA 002237654A CA 2237654 A CA2237654 A CA 2237654A CA 2237654 A1 CA2237654 A1 CA 2237654A1
Authority
CA
Canada
Prior art keywords
digital
digital communication
communication network
images
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA002237654A
Other languages
French (fr)
Inventor
Stephen Borza
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ActivCard Ireland Ltd
Original Assignee
DEW Engineering and Development ULC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DEW Engineering and Development ULC filed Critical DEW Engineering and Development ULC
Publication of CA2237654A1 publication Critical patent/CA2237654A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

An image capture system is disclosed wherein a plurality of video cameras are coupled directly to an Ethernet network and a monitoring system having a keyboard and several monitors is capable of polling the video cameras to receive images the video cameras have captured. The cameras are provided with processors for analysing captured images and for transmitting data determined from the analyses to the monitoring system.

Description

CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent Input device for use with Digital Networks Field of the Invention This invention relates generally -to video surveillance systems and more particularly relates to a video surveillance system using an Ethernet network for 5 communications.

Background of the Invention In a common video surveillance system for in~t~ tion in a building or group of buildings, a number of video cameras are disposed at predetermined locations within the building(s). At these locations, cabling e xists for carrying the video signals to a central 10 monitoring location. When cabling is not present, new cables must be installed, the cost of which is often significant. This usually deters moving video cameras within an existing building.

Once the video cameras and associated cabling are installed, a central security monitoring area is de~iign~tecl Therein is installed a plurality of monitors and analogue 15 switch boxes that allow for viewing of a plurality of different areas simultaneously. One monitor is capable of showing video images from any of a number of cameras. Video recording appa~ Lses are installed so as to capture signals as desired.

Existing video surveillance systems are very effective. They replace a large number of security personnel with a smaLller more centralised security staff equipped with 20 wireless communications devices communicating with the central security monitoring area. The use of video recording apparatuses is helpful in e~mining events after they have occurred.

For example, in a casino, monitoring of patrons and employees for undesirable activity is considered essential. A video camera placed above each table allows for 25 monitoring of players and employees. Electronic representation of the images are transmitted to one or more monitoring systems where security staff monitor the images to CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent identify emergency and other concerns. Concurrent with the display and monitoring of the images, recording of video images is performed for later analysis. At the end of a predetermined period of time, for example a day or a week, or when something appears amiss a careful review of the captured video images allows for a detection of any 5 undesirable acl.ivity.

In the technology industry, for example integrated circuit (IC) fabrication facilities, very small very expensive parts are manufactured, tested, and packaged.
Recently, theft of these parts has become commonplace. Unfortunately, technological industry chan~es frequently and requires a flexible system for monitoring and preventing 10 theft or other undesirable activities. Coaxial cables and video cameras are not easily moved every time a machine or assembly line relocates or is rearranged.

A field that has experienced considerable growth over the past few years is the field of video conferencing. Extremely expensive proprietary systems of years ago, have been replaced by portable, inexpensive "off the shelf" video capture devices connected to l S personal computers. Two examples of such devices are discussed below. For a UNIX
workstation produced by Sun Microsystems~), a digital camera is available, analogous to a video camera without a recording appdldllls, and associated software. The software compresses the video signal and displays it on a monitor. The compressed file is also tr~n~mi~sible across a digital computer network for display on another computer of a 20 similar type. E,i-directional tran~mi~ioll of video information and audio information provides video conferencing. Alternatively, small video clips can be stored on a computer and transferred as a video file to another computer for viewing at a later time.
A similar system, available for use with Macintosh~) computers and IBM~
compatible personal computers, is produced by Connectix(~ under the brand name 25 QuickCam~. The features supported by the QuickCam(E~;) are also image capture and compression for storage and tr~n~mi~ion.

A significant advantage of both the above mentioned systems is that they use existing data communications cabling within a business. Ethernet, a common data CA 022376~4 1998-0~-14 ~oc. No. 12-4 Patent communications protocol, is a system that is easily installed and for which cable drops are easily added or removed. Unlike coaxial cables that are installed from a location to a central monitoring location for each video camera, Ethernet cabling connecting data networks of computers carries data from a plurality of computers over a single physical 5 cable.

Though, the above video products are inexpensive when a computer already exists on a users desktop, acquiring a video capture device and a computer is costly. Further, the performance requirements for real time processing of video signals is still prohibitive.
Finally, connecting a video capture device to computers being used by employees,10 reduces perfor~mance of the computer and may adversely effect productivity.

There are known peripherals for connection to digital communication networks.
These peripherals include printers. Printers are output peripheral devices and as such are easily installecl on a digital communication network. Data transmitted to a network printer, is prinl~ed by the printer. Though output devices are easily connected to digital 15 communication networks, input devices, do not afford a same simplicity. To that end, input devices are not commonly attached to digital communication networks unless an output device iis included as part of the iinput device. Examples of such devices include personal computers.

It would be advantageous to provide an image input system that is easily installed, 20 modified, and expanded.

Object of the Invention It is an object of this invention to provide a video surveillance system that uses data communic,ation paths for tr~n.cmi~.~ion of video signals.

It is a fùrther object of the invention to provide a video surveillance system that 25 requires reduced bandwidth for data tran~mi~ion.

CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent Statement of the Invention In accordance ~with the invention there is provided an im~gin~ input system for use with a digital communication network supporting a digital comrnunication protocol, the digital network for sirnultaneous connection to a plurality of computers, the system comprising 5 an im~ging input device, the device comprising:
means -for capturing images and for providing digital representations of the lmages;
means -for receiving the digital representations of the images and for processing some of the digital representations to provide data in dependence thereon; and having a single digital data output port comprising a dedicated means unassistedby a personal computer, for providing some of the data to the digital comm~mications network using the digital communication protocol In an embodin:lent, the im~ging input device comprises a single housing and wherein the entire im~g,ing input device is housed within said single housing.

In an embodiment the only digital data interface to the surveillance camera is the digital communication network.

In accordance with the invention there is provided an im~gin~, input system for use with a digital communication network supporting a digital communication protocol, the digital network for simultaneous connection to a plurality of computers, the system comprising:
an image inpul: device comprising:
means for capturing images and for providing digital representations of the images;
means for receiving the digital representations of the images and for processing some of the digital representations of the captured images to provide data in dependence thereon consisting of at least a processor, non-volatile memory, volatile memory, and means for CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent providing some of the data to the digital communications network using the digital communication protocol.
In accordance with the invention there is provided an im~ging input system for use with a digital communication network supporting a digital communication protocol, the digital 5 network for sirnultaneous connection to a plurality of computers, the system comprising:
an image input device comprising:
a housing;
means, dispose d within the housing, for captwring images and for providing digital representations of the images;
10 means, disposed within the housing, for receiving the digital representations of the images and for processing some of the digital representations to provide data independence thereon; and means, disposed within the housing, for providing a compressed digital video output signal of some of the data to the digital commwnications network using the digital 15 commwnication protocol.

In accordance vvith the invention there is provided a method of captwring images for use with a digital communication network, l:he method comprising the steps of:
captwring imal~,es using image capture rrleans disposed in different locations;
providing digilal representations of the captured images to a processor;
20 processing the digital representations of the images using the processor;
transmitting the processed digital representations of the images to a monitoring system using a digital communication protocol supported by the digital commwnication network coupled between the image capture means and the monitoring system;
receiving the digital representations of the images at the monitoring system and25 alternately displaying images from different video cameras on a monitor coupled to the video server.

It is an advantage of the present invention that a single input system for use with a digital commwlication network and absent an output device or an attached personal computer is shareable among a plwrality of computer systems.
s CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent Brief Dcs~ ;~"ion of the Drawings An exe]mplary embodiment of the invention will now be described in conjunction with the attach~ed drawings in which:

Fig. 1 is a simplified block diagram of a video surveillance system according to the prior 5 art;
Fig. 2 IS a simplified block diagram of a video surveillance system according to the mventlon;
Fig. 3 is a method according to the invention for performing video surveillance across a digital network having a limited bandwidth;
10 Fig. 4 is another method according to the invention of performing video surveillance across a digital network having a limited bandwidth;
Fig. 5 is a simplified flow diagram of a method of selecting image frames captured by a camera for tr~rl~mi~sion via a digital nel:work;
Fig. 6a is a simplified flow diagram of another method of performing video surveillance 15 across a digital network having a limited bandwidth;
Fig. 6b is a simplified flow diagram of another method of performing video surveillance across a digita] network having a limited bandwidth;
Fig. 7 is a simplified flow diagram of a method of polling surveillance cameras for video surveillance via a digital network according to the invention;
20 Fig. 8 is a simplified flow diagram of a method of limiting bandwidth required to perform video surveillance via a digital network wherein each camera analyses images andtransmits to a video server a value in dependence upon the analyses;
Fig. 9 is a simplified flow diagram of a method of polling cameras in a video surveillance system incorporating the method shown in Fig. 8;
25 Fig. 1 Oa is a simplified block diagram of a surveillance camera according to the invention;
Fig. lOb is a simplified block diagram c~f a surveillance camera system according to the invention;

CA 022376~4 1998-0~-14 Doc.No. 12-4 Patent Fig. 11 is a simplified diagram of a plurality of computers and peripherals in communication via a digital communication network;
Fig. 12 is a simplified flow diagram of a method of user identification using an input im~ging systern according to the invention;
5 Fig. 13 is a simplified flow diagram of a method of user identification for actuating a door lock mechanism using an input im~ging system according to the invention;
Fig. 14 is a simplified flow diagram of a method of user identification ufor providing system access sing an input im:~ging system according to the invention;
Fig. 15 is a simplified flow diagram of a method of user identification for implementing 10 security measures for print outs using an input im~ping system according to the mventlon;
Fig. 16 is a simplified flow diagram of a method of user identification for implementing security measures for print outs using an input im~ging system according to the lnvenhon;
15 Fig. 17 is a simplified diagram of a plurality of computers and peripherals in communication via a digital communication network;
Fig. 18 is a simplified plan view of a building;
Fig. 19 is a simplified view of a biometric im~ing device for use with the present mventlon;
20 Fig. 20 is a simplified view of a printer provided with a biometric im~ging device for use with the present invention; and, Fig. 21 is a simplified view of a telephone provided with a biometric im~ging device for use with the present invention.

Detailed Description In video surveillance, it is often desirable to move a video camera around an area over time in order to alter investigation parameters or in order to narrow an area of surveillance. Il: is also desirable to increase a number of video capture devices in problem areas or for certain functions. Some examples of functions that are significant include visits by high ]profile individuals, open houses, etc. As described above, existing video CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent surveillance systems require significant effort in relocating video cameras and in installing new video sources.

Referring to Fig. 1, a high level block diagram of a video surveillance system according to the prior art is shown. A plurality of video capture means in the form of video S carneras 1 are clisposed in different locations. From each video carnera 1 a cable in the form of a coaxial cable extends to a switching system 2. Commonly, switching systems 2 are provided with l:iming control systems 4 as shown. The timing control system 4 switches between different camera signals automatically in a first mode and allows manual switching between video camera signals in a second mode. Many currently available switching and monitoring systems are computer controlled. As shown in Fig. 1, a plurality of monitors 3 each receive a signal from the switching system 2 allowing for viewing of any of a number of signals from. the video cameras 1.

During in~t~ tion, a cable is installed from each camera location to a central switching system location or to distributed switching system locations. Unfortunately, flexibility and relocatability of cameras 1 is greatly reduced using such a system.

Referring to Fig. 2, a high level block diagram of a video surveillance system according to the invention is shown. A digital comrnunications network 50 is installed within a building. Commonly, such a digital network already exists within a building.
Digital communications networks are well known in computer communications and telecommunications. Some examples of digital communication networks include Ethernet, Appletalk, Son net, ATM, and switched l,thernet. A monitoring system in the form of a video server 2()0v is coupled to the network 50. Coupling to digital comrnunication networks is oflen provided through an adapter card (not shown). It is apparent to those of skill in the art that such an adapter is commonly incorporated into the central monitoring system 200v and the video cameras 100.

In the e mbodiment of Fig. 2, the central monitoring system 200v is in the forrn of an IBM~ PC compatible computer provided with a plurality of monitors 300 and an Ethernet adapter board l not shown). The digital communication network 50 is an Ethernet CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent communications network. For timing, a timing source within the computer in the form of a real time clock is used.

A plurality of im~ging input devices in the form of video cameras 100 are disposed throughout a building, each coupled to the digital communication network 50. There are 5 many methods of achieving the connection. In an embodiment, the video cameras 100 are designed with ~m embedded processor and an Ethernet adapter. An Ethernet connector cable is directly coupled to the Ethernet adapter within the camera. Of course, for other digital networks other adapters are used. In this embodiment, due to the limitation of bandwidth over an Ethernet communication network, every pixel from every frame from every camera 10 is not transmitted. Each camera 100 captures and digitises images on an ongoing basis but only transmits a portion of digital representations of the images to the central monitoring system 200v. Alternatively, each camera 100 captures and digitises images on an ongoing basis but only lransmits digital representations of the images when a request from the central monitoring system 200vis received. Further alternatively, image capture and 15 tr~n.cmi~ion is only performed when a request for such is initiated by the central monitoring system 200v.

Referring to Fig. 3 a simplified flow diagram of a method according to the invention is shown. An im~ging input means in the form of a video camera 100 captures an image.
The image is digitised. Frame grabbers for performing the digitising are well known. Of course, when a digital camera is used, the use of frame grabbers is obviated. The digital representation in the form of a digitised image or a portion thereof is then compared to previous digital representation. Many methods of image comparison are applicable and within the scope of the invention. Several are set out below. When the digital representations are substantially similar when the new digitised image has substantially no new information over a previous image - no digital representation is provided to the monitoring system 200v via the digital network 50.

According to the invention, a video camera 100 typically operates as follows: animage is captured, a digital representation of the image is analysed for changes from a CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent previous image; when changes have not occurred, further images are captured; when changes have occurred the digital representation is compressed and the video camera 100 awaits a request from the monitoring station 200v for a digital representation of an image;
when a request for a digital representation of an image is received, the video camera 100 transmits either a signal indicative of no change or a compressed digital representation of the image. Of course, image throughput is limited by available bandwidth.

In a further embodiment, typical operation of a video camera 100 is as follows: an image is captured, a digital representation of the image is analysed for changes from a previous digital rel)les~ lion; when changes have not occurred, further images are 10 captured; when changes have occurred the digital representation of the image is compressed and transmittecl via the digital network to a video server.

Referring to Fig. 4, another method according to the invention of performing video surveillance is shown. An image captured with an image capture device in the form of a digital camera and a digital representation of an image in the form of an image frame is provided. When an analogue video camera 1OOa is used, the image is captured and digitised to form a digital image frame. When a digital video camera 1 OOb is used, the image data from the digital video camera lOOb is in -the form of an image frame. A predetermined portion of the image frame is compared to a predetçrmined portion of a previous image frame. When the video camera 100 is mounted in fixed relation to its surrolln~lin~s, the predetermined portions are a same portion. When the video camera 100 is movably mounted, the predetçrmined portions are comparable portions. When the image frames are of substantially same images, no image irame is transmitted through the digital network 50.
When a substantial difference between image frames is detected, the latest captured image frame is provided to the digital network i-or tr~n~mi~.~ion to the monitoring station in the form of a video server 200v.

Referring to Fig. 5, another method according to the invention of performing video surveillance is shown. A frame counter is reset. An image captured with an image capture device in the form of a digital camera, a digital representation of an image in the form of an CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent image frame is provided, and the frame counter is incremented. When the frame counter reaches a predetermined number, a frame is transmitted via the digital network 50 to the monitoring station 200v and the counter is reset. Alternatively, a predetermined portion of the frame is compared to a predetermined portion of a previous frame. When the images are 5 subst~nti~lly same images, no image frame is transmitted via the digital network 50. When a substantial difference between image frames is detected, the latest captured image frame is provided to the digital network 50 for tr~n~mi~ion to a monitoring station in the form of a video server 200v. Optionally, when the image frame is transmitted to the video server 200v, the frame counter is reset.

Referring to Fig. 6a, a simplified flow chart of a further embodiment according to the invention is shown. An im~ging input device in the form of a video camera 100 captures and stores video images in an analogue or in a digital fashion in non-volatile memory.
When captured and stored as analogue representations of images, the representations are then digitised to form digital representations of images in the form of image frames. A
15 portion of a culTent digital image frame is compared to a portion of a previous digital image frame. When the portions are substantially similar, further images are captured. When the portions are su~lciently ~ imil~r, index information relating to the current digital image frame is stored and the current digital image firame is transmitted to a monitoring station in the form of a video server 200v. Optionally, the indexing information is transmitted with 20 the digital image firame.

Referring to Fig. 6b, a simplified flow chart of a further embodiment according to the invention is shown. An im~ging input device in the form of a video camera 100 captures images, stores J~ples~ lions of images in an analogue or a digital fashion in non-volatile memory, and provides a digital representation of the stored images. A portion of a current 25 digital image fi ame is compared to a portion of a previous digital image firame. When the portions are substantially similar, further images are captured. When the portions are sufficiently different, index information r.elating to the current digital image firame is transmitted to the video server 200v. Pre~ferably, the current digital image firame is stored in a retrievable location associated with the index information for retrieval upon receipt of a CA 022376~4 1998-0~-14 Doc.No. 12-4 Patent request from the video server 200v for the image frame and for tr~n~mi~ion to the video server 200v upon retrieval.

The invention is applicable to use with high speed digital networks. The preferred bandwidth of the digital network is determined in dependence upon a type of surveillance, 5 amount of on demand bandwidth desired, a number of cameras, and an arnount of network traffic attributed to other network traff1c sources.

In accordance with the invention. a plurality of video cameras l O0 are coupled directly to the digital network 50. It is evident to those of skill in the art that a direct connection is a,chievable through the use of a video capture device having incorporated 10 therein a digital network access card and a processor or, alternatively, using a known video camera and an adapter external thereto for coupling between the camera and the digital network and for providing the desired functionality. Each video camera 100 provides digital image frames to the digital network 50 at intervals. The intervals need not be regular or same intervals. For example, a video camera at a predetermined location provides every 15 second image frame captured to the digital network 50 and other cameras each provide every eighth image frame captured to the digital network 50, thereby accommodating 5 video cameras 100 on a digital network 50 having sufficient bandwidth to support a video signal from a single video camera 100.

Referring to Fig. 7, a simplified flow diagram of a method of polling video cameras 20 on a digital network is shown. Each camera is associated with an time-slot. A timer in the form of a real time counter counts time. When the time is associated with a camera time slot occurs, a camera associated with that time-slot is polled. Of course, many systems exist for time-sharing or other resource allocation that are applicable to polling as used in the present mventlon.

Referring to Fig. 8, a simplified flow diagram of a method wherein digital representations of images are weighted and the most weighty digital representations are transmitted. Each video camera 100 captures an image and analyses a digital representations of the image fo:r predetermined indicators. Examples of indicators are changes from a last CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent transmitted digital representation, visibility of predetçrmined markers within a digital representations ofthe image, etc. Each video camera 100 transmits a value detçrrnined in dependence upon the analysis to a central monitoring system 200v. The central monitoring system 200v detçrmines a video camera 100 or a plurality of video cameras 100 from which 5 to request a digital representations of an image. Upon receiving a request, a video camera 100 transmits t]he weighted image to the central monitoring system 200v. In such a fashion, high priority images are automatically displayed or recorded at the central monitoring location in dependence upon an indicator other than time.

Referring to Fig. 9, a method wherein digital representations of images are 10 transmitted at regular intervals according to a polling or time sharing method outlined above has incorporated therein a method of analysing the digital representations of images to detçrmine wei~;htings therefore. When weighted digital representations are requested, other digital bandwiclth than that allocated to the video monitoring system is used to transmit the requested digit~ll representations. According to the flow diagram of Fig. 9, each camera 15 transmits a digital representation of an image or a plurality of successive images at predetermined intervals. Each frame that is not already sent to the central monitoring system is analysed. Of course, those frames transmitted may be analysed as well. Values det~rmined in clependence upon the analyses are transmitted to the central monitoring system 200v and an individual or a co~ ulel algorithm detçrmin~s whether or not to 20 request a partic-ular weighted image. A simple algorithm for making the d~l~ . "~ tion is a threshold algoriithm where weightings above a threshold T result in a request and weighting~ below the threshold T do not so result. When requested, the weighted image frame is tr~n~mitted via data bandwidth on the digital network other than that allocated for the video surveillance system's normal operation.

:25 In operation, the use of an extra monitor with the monitoring system allows images having a greatest significance to be displayed on the extra monitor while images from the surveillance cameras received according to a predetermined pattern of polling are displayed and/or recorded.

CA 022376~4 1998-0~-14 ..

Doc. No. 12-4 Patent It is evident to those of skill in the art that computers and an im~eing input system as taught herein can share a single digital network. It is preferable that such a network comprise prioritisation of digital tr~n~mi.~ions to ensure data throughput for both important im~ing and da~ta co~ lications operations.

S Setting up each camera for image analysis is preferably performed by security staff once the camera is installed. The staff sets the camera to ll~lllil images to the central monitoring station and, through configuration or plcfelcnce settings determines an algorithm for weighting images and portions of each image for analysis. These parameters are then transmitted to the camera. When desirable, the images and values deterrnined by analysis are reviewed to ensure proper functioning of a camera. Alternatively, the configuration and/or plcr~lcllces are established using a training algorithm such as a genetic algorithm, a ne-ural network, or an ~nne~ling algorithm provided with images that are weighted by serurity staff as a training data set.

When bandwidth considerations are significant or unknown, video image colllplcssion is implemented within each camera and decompression is implemented in the central monitoring system. Video compression routines such as MPEG are extremely well suited to applications of this type, as are other known video compression systems that result in minim~l loss of image quality. Preferably, when image quality is lost throughcompression, each frame is indexed and ~m individual at the central monitoring system is capable of requesting and receiving a frame from a recording without loss in dependence upon indexing iinformation. One method of accomplishing this is using a plurality of video recorders with a single video camera wherein one records at any given time allowing the other recorder to retrieve images. In such a system, frame inrl~xine for accurate reconstruction is ess~nti~l. Alternatively, two tapes can record simultaneously. One of the tapes providing a master while the other allows for retrieving past frames.

The use of a digital network 50 as described herein provides numerous advantages.
Network topology changes for digital networks are generally easily implemented without requiring extensive in.ct~ tion of cable Digital networks are designed to be modified and CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent to allow for relocation of computers comlected thereto; therefore, they are well suited to allowing surveillance cameras to move as necessary. Digita~l networks also have an advantage of being installed in many buildings for computers therein. The presence of such an infrastructure, reduces the overall cost of implementing a video surveillance system 5 according to the invention. The use of a digital network 50 allows the central monitoring station to be relocated without significant difficulty.

The use of a digital network 50 according to the invention for conveying the surveillance ini ormation, also allows security personnel to view surveillance information from remote locations or from locations within the building that are not designated security 10 monitoring stations. For example, when a fire alarm is reported, a security person monitors the surveillance systems about the fire. It is often preferable that the monitoring be performed in c]ose proximity to the fire in order to aid rescue personnel. As such, a workstation proximate the fire is used for surveillance and the emergency personnel are capable of monitoring the situation visually upon arrival. One method of accomplishing this 15 is to send a nevv network address for the monitoring system to the im~ging input device.
Another method is to retransmit received digital representations from the monitoring system to a computer proximate the fire.

The central monitoring station 200v is a computer functioning as a server and coupled with al least a monitor 300. Preferably the central monitoring station 200v is 20 provided with a recording system for recording images provided through the digital network 50 thereto. Alternatively, some video cameras 100 are provided with recording means.
Recording means are well known in the art and include magnetic recording means as found in conventiona] video cameras and digital recording means - a computer coupled with each camera for receiving a digital signal therefrom and for recording the digital signal in non-25 volatile memory. When a computer is used as a recording means, the computer preferablytransmits the recorded data to a network data server for backup at some later time.

The central monitoring system 200v comprises software for controlling the video cameras 100. This software comprises test software for verifying a presence and operation CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent of cameras; set-up software for initi~ ing cameras and for loading preferences, algorithrns, and other data iinto cameras; and Op~ldlillg software for polling cameras, receiving image data from video cameras, and for recording camera data for future review.

For example, a central monitoring station in the form of a video server 200v is 5 provided with a plurality of monitors. On some of the monitors, images provided via the digital network 50 to the video server 200v are displayed. Another monitor displays surveillance related information in the form of current camera status, camera locations, etc.
Optionally, the system also displays information relating to security in the forrn of fire alarm status, door status, and so forth.

In a preferred embodiment, the displayed inforrnation is automatically displayed in accordance with a default display mode. The default display mode is capable of being overridden by security staff in order to view particular images, locations, or status information. This provides a hands-offmonitoring system with the flexibility required for surveillance operations.

Referring to Fig. 1 Oa a simplified block diagram of a video surveillance cameraaccording to thl invention is shown. The digital video camera 100b comprises im~ging means in the form of a lens and a charge coupled device (CCD), an analogue to digital converter, RAl\~, a processor, and a digital communication means in the form of a digital network interface circuit. Optionally, the analogue to digital converter is integrated into the 20 CCD. The processor means is for p~,.ro~lllhlg at least one of two functions - compression and analysis. Compression is used to reduce image data to reduce consumption of digital network bandwidth. Analysis is used to evaluate captured images in order to conserve network bandwidth when digital representations of images have little information over previously transmitted information.

:25 Preferably, the device of Fig. 1 Oa is contained within a single housing and forms an integrated video camera for interfacing with a digital network.

CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent Referring to Fig. lOb, another embodiment of the surveillance video camera is shown wherein the image capture means in the form of a lens and a CCD are contained within one housing and the rem~ining electronics is contained within another housing. This permits the image capture means to remain small for easily being concealed from view. The S rem~in-ler of the electronics forms a processing unit and is located a distance away, for example within a wall or a utility closet. When the processor means is sufficiently powerful, a plurality of inn~ging means is optionally connected to a single processing unit. This is useful for monitoring small areas with several image capture means simultaneously.

According to another aspect of the invention, a digital network has installed 10 thereon video cameras and biometric sensors. The biometric sensors are used for authorising system access across the network. Some example applications are discussed below.

Referring to Fig. 11, a digital network 50 in the form of an Ethernet network isinstalled within a building. Digital networks, as described above, are well known. For 15 example, an Ethernet network provides an easily upgraded and modified network. To the digital network; SO are connected workstations 54 and servers 56. The workstations 54 are computer systems for use by users. The servers 56 are for providing central file storage, network applications, and more powerfill processors for executing processor intensive tasks. Some common network applications include email, intranet, accounting, parts lists, 20 employee phone list, etc. Biometric sensors 21 Oa and 21 Ob are coupled directly to the digital communication network 50 at a plurality of locations. Optionally, biometric sensors 210a are coupled to workstations 54a coupled to the digital communications network 50.

Network security is enhanced through biometric identification of users. The 25 biometric idenlification of individual users permits a plurality of easily enforced user access levels, a.ccurate billing of network use, and integration of electronic equipment for accounting and. security. Referring to Fig. 11, a plurality of comrmon network peripherals such as workstations 54, servers 56, and printers 58 are shown. Unconventional network CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent peripherals such as video source devices 100, door locks 62, biometric sensors 21Oa and 21 Ob, and video server 200v are shown. Optionally, peripherals such as vending machines, photocopiers, telephones, facsimile machines, supply cabinets, manufacturing equipment, and inventory storage bins are also in communication with the digital network 5 50.

Through a~ropliate hardware and co-operating software, each peripheral receives information in dependence upon a user identification. This information is used to provide security functions or to provide activity logs and billing related information.

Network access is provided through biometric information authentication.
10 Referring to Fig. 12, a user desiring to use a network function requires authorisation. User authorisation is performed by identifying a user in dependence upon biometric information provided by the user. A user desiring to use a peripheral connected to the digital network. 50 provides a user identification in the form of a PIN, a name, or a log in ID. The user then identifies the peripheral device to be used. Some examples of 15 peripheral devices according to the invention include video cameras, printers, phones, doors, computer systems, and environmental controls. The user then provides biometric information at a biometric input device 21 Oa or 21 Ob (See Fig. 1 1). Preferably, each of the data inputs from the user are provided at a sarne input terminal. When user identification i s complete and the user has access privileges to the peripheral device, 20 access is provided; optionally, the activity - either access or denied access - is logged.

Referring to Fig. 13, a specific embodiment of the method described with reference to Fig. 12 is shown wherein the peripheral device is a door lock mech~ni~m A
user provides user identification, a doorway identifier and biometric inforrnation to a biometric inpul: device 21 Ob. Once user identification is complete and the biometric 75 information is iidentified as that of the user, and provided that the user is permitted access through the identified doorway, the door lock is actuated and the user is permitted to pass therethrough; optionally, the event is recorded in an activity log.

CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent Referring to Fig. 14, a method of accessing a peripheral system is shown. A userprovides biometric information at a biometric sensor 21 Ob coupled to the digital network 50. The user is identified in dependence upon the biometric information provided. Access privileges for the user are determined. The user then accesses a peripheral proximate the 5 biometric sensor. Some methods of accessing a peripheral system include turning a door knob, pressing a function button on a printer or photocopier, executing a software program, and lifting a telephone handset. For example, when a security person wants to view images from a predetermined video camera, the security person provides biometric information to a biometric sensor 21 Ob proximate a computer workstation 54. The10 security person then actuates a software program for viewing video images from the predetermined video camera on the workstation 54. When the security person is identified and has access privileges to the software program, the program executes; optionally, a record of the e vent is stored in an activity log. Similarly, an executive is permitted to make long distance calls from any telephone connected to the digital network 50 and the l 5 telephone call is logged according to the executive's preferences and billed to his budget.

When a user attempts to access or to "log on" to a server 56a, the user providesbiometric information to a biometric sensor 210b for ~llthentication. Once identified, the user is either permitted access to the server 56a or denied said access. When a biometric sensor 21 Oa is coupled to a workstation 54a, this is straightforward as existing log on 20 procedures modified to accept biometric information are used. When the biometric sensor 21 Ob is coupled directly to the digital network 50, some indication must be provided that a specific biom~etric sensor is being used by a particular user. For example, a biometric sensor 210b is associated with a workstation 204b. Alternatively, a biometric sensor is provided with a keypad for entering further information. A workstation asks for a user ID
25 and biometric information number 2123. The user then provides biometric information to the biometric slensor 21 Ob and keys 2123 into a keypad associated therewith. The information is ]provided to a central security server for user authentication and system access.

CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent Referring to Fig. 15, the network 50 is also provided with a printer 58. The printer is provided wilh a memory buffer for storing printer output. When a secure document is transmitted to lthe printer, it is stored in the memory buffer and not printed. A user desiring to col]ect secure printouts provides biometric information to a biometric sensor 5 210b adjacent the printer and thereby initiates printing of confidential material. As such, confidential printouts are protected even on the network. Alternatively, the biometric input device is integrated into the printer and the user provides biometric information to the printer 58 directly or to the digital network 50 via the printer 58. When the biometric sensor is integrated into the printer and dedicated to printer security, identifying a 10 peripheral when providing the biometric information is unnecessary. When a biometric input device integrated within the printer 58 is merely another biometric input device 210 coupled to the digital network and not dedicated to printer security, identification of a peripheral is required.

Referring to Fig. 16, a simplified flow diagram of a method of enhancing security 15 of print outs without requiring special printer hardware is shownA print server is provided with a memory buffer for storing printer output. When a secure document is transmitted to the server for printing, it is stored in the memory buffer and not printed. A
user desiring to collect secure printouts provides biometric information to a biometric sensor 210b adjacent the printer, the server m~int~ining secure printouts receives the user identification and a printer to which to transmit the print job. The print job is transmitted to that printer thereby initiating printing of confidential material. As such, confidential printouts are protected even on the network 50.

Referring to Fig. 17, a system for building surveillance and security is shown. A
video server in the form of a computer network server 206v is coupled to a digital network 50. A plurality of video cameras 100 are coupled to the network 50. Each video camera 100 provides a video image frame to the video server 206v when a significant change occurs over a previous image frame. Preferably, significant changes are defined in dependence upon a desired level security. For example, in a low traffic area where a high level of security is desired, any change is significant. Alternatively, in high traffic areas, CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent only a portion of an image frame is significant - for example, a desk drawer or removal of particular equi]pment. As such, when a change in an image frame over a previous image frame is signifiicant, the image frame is provided via the digital network 50 to the server 206v. This is accomplished in accordance with a method as set out above.

The image frames are displayed on a monitor forming part of the video server 206v. Security personnel can select a video source 100 to monitor or can simply view image frames that change as change occurs. When a significant change is detected, a security person is dispatched to inspect. On the way, the security person accesses several secure areas 220, 221, 222, and 223 (shown in Fig. 18). In order to access each area, biometric infoImation is provided to a biometric input sensor 210b. At each doorway, a workstation 54 is disposed. The security person identifies the video camera 100 and provides biometric information and is provided with images from the video camera 100 on the workstation 54 prior to passing through each secure doorway. Only predetermined individuals can access the video information on the network 50.

Referring to Fig. 19, a biometric im~gin~ input device for use with the invention is shown. The device is provided with a numeric key pad 191 for entering user identification codes in the form of PIN numbers. A speaker 192 provides auditoryfeedback in the form of access permitted or denied. Optionally, the speaker allows security personnel to speak to users attempting access. When the bi-directional communication is desirable, a microphone is included within the biometric information input device. A. biometric input means 193 in the form of a platen upon which a finger tip is rested to allcw for im~ging of a finge~lJfilll is disposed on the face of the unit. A digital communication interface in the form of an Ethernet connector and associated circuitry (not shown) is provided to permit installation of the sensor device on a digital network.

:25 Of course, telephones disposed on a digital communication network 50 are controlled in a similar fashion. When someone's pager indicates an incoming call, they provide biometric information to a biometric input sensor 210b and the call is provided to a closest telephone. Alternatively, they provide biometric information and an extension CA 022376~4 1998-0~-14 Doc. No. 12-4 Patent number and a telephone having that extension number is provided with the call. Referring to Fig. 21, when a telephone is provided with an integrated biometric information sensor 193, the person Iifts the handset while providing biometric information to the integrated biometric sensor 193 in order to provide same functionality.

Many aLpplications for the method according to the invention are envisioned.
Device access and activity logs provide significant advantages for automatic teller machines, hospital medication and equipment access, corporate cost ~ses~ments and allocation of expenses, employee time monitoring - punching in and punching out, safety deposit boxes, etc. The use of biometric sensors to identify an individual and to restrict access is well known; however, the combination of security in dependence upon biometric input information and monitoring or logging of non computer system access provides signif;cant advantages as described above.

Alternatively, when a biometric input device is integrated into a peripheral device, the peripheral device is a default peripheral that is identified according to the method of the invention in the absence provision of another peripheral identification.

Alternatively, a video camera is replaced with a digital camera for capturing individual images. When such is the case, image acquisition is initiated by a signal from the central monitoring system.

Numerous other embodiments may be envisaged without departing from the spirit and scope of the invention.

Claims (20)

1. An imaging input system for use with a digital communication network supporting a digital communication protocol, the digital network for simultaneous connection to a plurality of computers, the system comprising an imaging input device, the device comprising:
means for capturing images and for providing digital representations of the images;
means for receiving the digital representations of the images and for processingsome of the digital representations to provide data in dependence thereon; and having a single digital data output port comprising a dedicated means unassistedby a personal computer, for providing some of the data to the digital communications network using the digital communication protocol.
2. An imaging input system for use with a digital communication network as defined in claim 1 wherein digital communication protocol is Ethernet.
3. An imaging input system for use with a digital communication network as defined in claim 1 wherein the input device comprises means for identifying the imaging input device to other devices in communication with the digital communication network.
4. An imaging input system for use with a digital communication network as defined in claim 1 wherein the imaging input device comprises means for receiving data from the digital communication network and means responsive to received data for configuring the surveillance camera.
5. An imaging input system for use with a digital communication network as defined in claim 1 wherein the imaging input device comprises means for receiving data from the digital communication network and means responsive to received data for determining data to provide to the digital communication network.
6. An imaging input system for use with a digital communication network as defined in claim 1 wherein the only digital data interface to the imaging device is the digital communication network.
7. An imaging input system for use with a digital communication network as defined in claim 1 wherein the only image data output from the imaging device is the digital communication network.
8. An imaging input system for use with a digital communication network as defined in claim 1 wherein the imaging device is a surveillance camera.
9. An imaging input system for use with a digital communication network as defined in claim 1 wherein the imaging device is a biometric imaging device.
10. An imaging input system for use with a digital communication network as defined in claim 1, the system comprising:
a monitoring system for coupling with the digital communication network at a location different from that of the means for imaging, the monitoring system comprising:
means for receiving data provided by the means for providing some of the data tothe digital communications network, and means for displaying or recording the data.
11. An imaging input system for use with a digital communication network as defined in claim 5 comprising:
a monitoring system for coupling to the digital communication network at a location different from that of the imaging input device, the monitoring system comprising:

means for receiving data provided by the means for providing some of the data tothe digital communications network, means for communicating with the means for receiving data from the digital communication network of the imaging input device to request a transmission of data; and means for displaying or recording the data.
12. An imaging input system for use with a digital communication network as defined in claim 1 wherein the imaging input device comprises a single housing and wherein the entire imaging input device is housed within said single housing.
13. An imaging input system for use with a digital communication network as defined in claim 12 wherein the only digital data interface to the surveillance camera is the digital communication network.
14. An imaging input system for use with a digital communication network supporting a digital communication protocol, the digital network for simultaneous connection to a plurality of computers, the system comprising:
an image input device comprising:
means for capturing images and for providing digital representations of the images:
means for receiving the digital representations of the images and for processingsome of the digital representations of the captured images to provide data in dependence thereon consisting of at least a processor, non-volatile memory, volatile memory, and means for providing some of the data to the digital communications network using the digital communication protocol.
15. An imaging input system for use with a digital communication network supporting a digital communication protocol, the digital network for simultaneous connection to a plurality of computers, the system comprising:

an image input device comprising:
a housing;
means, disposed within the housing, for capturing images and for providing digital representations of the images;
means, disposed within the housing, for receiving the digital representations of the images and for processing some of the digital representations to provide data independence thereon; and means, disposed within the housing, for providing a compressed digital video output signal of some of the data to the digital communications network using the digital communication protocol.
16. A method of capturing images for use with a digital communication network, the method comprising the steps of:
capturing images using image capture means disposed in different locations;
providing digital representations of the captured images to a processor;
processing the digital representations of the images using the processor;
transmitting the processed digital representations of the images to a monitoring system using a digital communication protocol supported by the digital communication network coupled between the image capture means and the monitoring system;
receiving the digital representations of the images at the monitoring system andalternately displaying images from different video cameras on a monitor coupled to the video server.
17. A method of capturing images for use with a digital communication network asdefined in claim 16 comprising the steps of:
analysing the digital representations to provide a score associated with a digital representation; and transmitting the scores for digital representations to a monitoring system using a digital communication protocol supported by the digital communication network coupled between the image capture means and the monitoring system, and, wherein the step of transmitting the processed digital representations of the images to a monitoring system using a digital communication protocol supported by the digital communication network coupled between the image capture means and the monitoring system is performed in dependence upon a signal transmitted from the monitoring system using the digital communication protocol supported by the digital communication network.
18. A method of capturing images for use with a digital communication network asdefined in claim 16 wherein the step of transmitting the processed digital representations of the images to a monitoring system using a digital communication protocol supported by the digital communication network coupled between the image capture means and the monitoring system is performed in dependence upon differences between the digital representation and a previous digital representation.
19. A method of capturing images for use with a digital communication network asdefined in claim 16 wherein the step of transmitting the processed digital representations of the images to a monitoring system using a digital communication protocol supported by the digital communication network coupled between the image capture means and the monitoring system is performed in dependence upon differences between predetermined portions of the digital representation and same predetermined portions of a previous digital representation.
20. A method of capturing images for use with a digital communication network asdefined in claim 16 comprising the step of providing biometric information to a biometric information sensor, and wherein at least one of the steps of transmitting the processed digital representations of the images to a monitoring system and displaying images on a monitor coupled to the video server is performed in dependence upon the biometric information provided.
CA002237654A 1997-06-16 1998-05-14 Input device for use with digital networks Abandoned CA2237654A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US87661297A 1997-06-16 1997-06-16
US08/876,612 1997-06-16

Publications (1)

Publication Number Publication Date
CA2237654A1 true CA2237654A1 (en) 1998-12-16

Family

ID=25368152

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002237654A Abandoned CA2237654A1 (en) 1997-06-16 1998-05-14 Input device for use with digital networks

Country Status (1)

Country Link
CA (1) CA2237654A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001013637A1 (en) * 1999-08-12 2001-02-22 Honeywell Limited System and method for digital video management
WO2001019076A1 (en) * 1999-09-02 2001-03-15 Vitronic Dr.-Ing. Stein Bildverareitungssysteme Gmbh Circuit for generating image data for a pc and an appropriate data transfer method
WO2001041438A1 (en) * 1999-12-02 2001-06-07 Madge Networks Limited Video communication system
WO2003032646A1 (en) * 2001-10-05 2003-04-17 Media Trans Tech Solutions, S.L. Video surveillance system for vehicles
EP2911387A4 (en) * 2012-10-17 2016-01-06 Hangzhou Hikvision Digital Tec Video image quality diagnostic system and method thereof

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001013637A1 (en) * 1999-08-12 2001-02-22 Honeywell Limited System and method for digital video management
US7859571B1 (en) 1999-08-12 2010-12-28 Honeywell Limited System and method for digital video management
WO2001019076A1 (en) * 1999-09-02 2001-03-15 Vitronic Dr.-Ing. Stein Bildverareitungssysteme Gmbh Circuit for generating image data for a pc and an appropriate data transfer method
WO2001041438A1 (en) * 1999-12-02 2001-06-07 Madge Networks Limited Video communication system
WO2003032646A1 (en) * 2001-10-05 2003-04-17 Media Trans Tech Solutions, S.L. Video surveillance system for vehicles
EP2911387A4 (en) * 2012-10-17 2016-01-06 Hangzhou Hikvision Digital Tec Video image quality diagnostic system and method thereof
US10015529B2 (en) 2012-10-17 2018-07-03 Hangzhou Hikvision Digital Technology Co., Ltd. Video image quality diagnostic system and method thereof

Similar Documents

Publication Publication Date Title
US6385772B1 (en) Monitoring system having wireless remote viewing and control
KR100442170B1 (en) Remote Control and Management System
JP3563889B2 (en) Camera control system and camera control system control method
EP0967584B1 (en) Automatic video monitoring system
US6271752B1 (en) Intelligent multi-access system
US7106176B2 (en) Portable device-interoperable home network system
US6002995A (en) Apparatus and method for displaying control information of cameras connected to a network
KR100654783B1 (en) Image distribution method
US8144763B2 (en) Imaging apparatus, imaging system and method thereof
KR200433431Y1 (en) Standalone surveillance system
US20020187791A1 (en) Security system and security apparatus
CA2237654A1 (en) Input device for use with digital networks
KR20020048188A (en) Remote Monitoring System Using Mobile Communication Device Capable of Receiving Image Data and Connecting to Internet, and Remote Monitoring Method Using the Same
AU759177B2 (en) Improvements in or relating to control and/or monitoring systems
GB2390272A (en) Network connection management system
EP2343888A1 (en) Communication wall panel, care system equipped with communication wall panel, and conference system equipped with communication wall panel
JP2002165211A (en) Security monitoring system using telecommunication network, program for making computer perform basic function of security monitoring system and recording medium storing the program
KR100364859B1 (en) Apparatus and method for remote monitoring using Internet access device and service server
US11393310B2 (en) Surveillance system
JP4553221B2 (en) Monitoring and reporting method and system, and computer-readable information recording medium recording monitoring and reporting program
US20050078183A1 (en) Image pickup device and image pickup method
EP1480409A2 (en) Digital video recorder having an internet phone and communication method thereof
JP2005094642A (en) Surveillance camera system
KR100887899B1 (en) Web camera for personal broadcasting and method for providing personal broadcasting service in internet server
WO1998032106A1 (en) Video security systems

Legal Events

Date Code Title Description
FZDE Dead