US20150002898A1

US20150002898A1 - Apparatus for capturing, converting, and transmitting a visual image signal via a digital transmission system

Info

Publication number: US20150002898A1
Application number: US14/484,338
Authority: US
Inventors: David A. Monroe
Original assignee: e-Watch Inc
Current assignee: e-Watch Inc; Telesis Group Inc
Priority date: 1998-01-12
Filing date: 2014-09-12
Publication date: 2015-01-01
Also published as: AU2223999A; US20020109863A1; EP1062801A4; US20080242351A1; CA2341159A1; WO1999035818A2; EP1062801A2; US20140327928A1; WO1999035818A3; US20040001214A1; US20140327931A1; US7365871B2

Abstract

An image capture, conversion, compression, storage and transmission system provides a data signal representing the image in a format and protocol capable of being transmitted over any of a plurality of readily available transmission systems and received by readily available, standard equipment receiving stations. In its most comprehensive form, the system is capable of sending and receiving audio, documentary and visual image data to and from standard remote stations readily available throughout the world.

Description

CROSS REFERENCE TO RELATED APPLICATIONS

This continuation patent application claims priority to United States (U.S.) Non-Provisional patent application having Ser. No. 14/149,154 filed Jan. 7, 2014 entitled “APPARATUS FOR CAPTURING, CONVERTING, AND TRANSMITTING A VISUAL IMAGE SIGNAL VIA A DIGITAL TRANSMISSION SYSTEM”. U.S. Non-Provisional patent application having Ser. No. 14/149,154 claims priority as a continuation patent application to U.S. Non-Provisional patent application having Ser. No. 12/113,581 filed May 21, 2008 entitled “APPARATUS FOR CAPTURING, CONVERTING, AND TRANSMITTING A VISUAL IMAGE SIGNAL VIA A DIGITAL TRANSMISSION SYSTEM”. U.S. Non-Provisional patent application having Ser. No. 12/113,581 claims priority as a continuation patent application to U.S. Non-Provisional patent application having Ser. No. 10/336,470 filed Jan. 3, 2003 entitled “APPARATUS FOR CAPTURING, CONVERTING, AND TRANSMITTING A VISUAL IMAGE SIGNAL VIA A DIGITAL TRANSMISSION SYSTEM” and now U.S. Pat. No. 7,365,871. U.S. Non-Provisional patent application having Ser. No. 10/336,470 claims priority as a divisional patent application to U.S. Non-Provisional patent application having Ser. No. 09/006,073 filed Jan. 12, 1998 entitled “APPARATUS FOR CAPTURING, CONVERTING, AND TRANSMITTING A VISUAL IMAGE SIGNAL VIA A DIGITAL TRANSMISSION SYSTEM”. All of these applications having a common inventor herewith and are being incorporated herein in their entirety by reference.

BACKGROUND OF THE INVENTION

The invention is generally related to image capture and transmission systems and is specifically directed to an image capture, compression and transmission system for use in connection with land line and wireless telephone systems.

SUMMARY OF THE INVENTION

Embodiments provide an image capture, compression and transmission system that is specifically designed to permit reliable visual image transmission over land line or wireless communications using commercially available facsimile transmission techniques. Embodiments incorporate a camera and signal converter into an integrated unit wherein the converted signal can be transmitted on a real time basis or may be stored in memory for later recall and transmission. Embodiments provide maximum flexibility, with the camera/converter/telephone or other transmission device being designed in a modular configuration wherein any or all of the devices can exist as integrated or independent units.
Embodiments permit capture of a video image using a digital camera, an analog camera, or a video camera such as a camcorder. The captured video image is then converted into still frame digitized format for transmission over any of a variety of transmission systems ranging from Group-III facsimile to computer, or to a like device at a remote location, in any protocol desired. According to embodiments, once the signal is digitized, the transmission protocols are virtually endless.
Embodiments permit a still frame visual image to be captured at a remote location and sent immediately, over wireless communication systems, to a remote location such as, by way of example, a. computer system wherein the image could be merged directly into newsprint. The image may also be sent to and printed as a hard copy using any Group III facsimile machine, anywhere in the world. Where desired. the images may be stored in memory for later recall, and may be archived on a portable medium such as a memory card or the like.
Embodiments are useful for applications where immediate transmission of visual images of scenes, people and objects is desirable and sophisticated equipment is not always available for receiving the information. Embodiments also provide a unique and reliable means for transmitting visual data to and from remote locations, such as, by way of example, law enforcement and emergency vehicles and the like.
In an embodiment a system includes a video camera and an integral cellular telephone, wherein the telephone using the standard audio mode or future digital modes, can be used to transmit and receive visual image signals. An embodiment including a desk model is also disclosed and permits connection to a standard land line telephonic system. An embodiment including a mobile console model is disclosed for use in law enforcement vehicles, and the like. Other communication systems are also supported embodiments, including hard wired networks, radio and satellite transmission and the like.
In embodiments, a local facsimile machine can be incorporated with the unit and can serve as a printer for providing hard copy of the captured image at the point of capture, as well as being adapted for receiving facsimile transmissions in the standard fashion.
Embodiments disclose circuitry for supporting any configurations from a basic real time transmission system via Group-III fax to a comprehensive system supporting both land line and wireless transmission of image, audio and documentary data at both a local and remote station.
Embodiments permit also permits digitized collection of audio signals through the use of an internal microphone, and external input device, a cellular telephone, land line telephone, wireless radio or other communication system, and digitized audio playback, as well The playback can be via an internal speaker, out an external out jack to a remote device or via a cellular telephone, land line telephone, wireless radio or other communication system.
In embodiments, digitized image and audio capture features permit association of audio with an image, as well as data with the image. Useful data associated with the image includes GPS from either internal or external GPS devices, range information from ranging devices, date and time, and text which may be input from an integrated keyboard or from a remote device.
In embodiments, a system supports storage of images in an interim storage format including raw video, compressed video, interim gray scale format and/or halftone format. In embodiments, the image can also be stored in the selected output mode, such as by way of example, a Group III facsimile mode. According to the embodiments, the versatile capability of a system permits transmission of captured data to a standard bi-level facsimile machine such as Group III, to gray scale facsimile systems or full color facsimile systems, as well as to other remote receiving devices such as, by way of example, personal computers and network servers. The data can be transferred in any of a variety of formats and protocols including JPEG, FAX, wavelets, emerging imagery formats, FAX and computer data protocols. Embodiments are adapted to operate in multiple modes, with a unitary capture and send mode or separate capture and store, and send modes.
In an embodiment, the system is adapted for tagging a collected image, video, audio, and other data such as a GPS information, with geospatial information and real time clock and added text This permits the complete historical data to be transmitted simultaneously with the image signal.
According to embodiments, is contemplated that a system can be self-contained with an integral power unit such as a disposable battery, rechargeable battery source or the like. Therefore, the system is adapted to power up when in use and power down or “sleep” when not activated, preserving power during idle time. The power systems for the video camera, the video input circuits and converters, the modem or other transmission devices and other high drain components may he isolated and only powered when needed. This also permits use of ancillary functions, such as use as a cellular telephone, to proceed without draining the power source by powering idle components. The processor clock rate may also be slowed down during idle mode to further conserve power.
According to embodiments, where a system also includes camera operation control capability through the use of digital/analog circuits for converting digital commands to analog signals for controlling the gain, pedestal, setup, white clip, lens focus, white balance, lens iris, lens zoom and other functions of the camera from a local input device, a remote device or as automatic or programmed functions. The central processor can also be used to control camera shutter rate. Other camera features and parameters which can be controlled in this manner are compressor resolution (such as high, medium, low user settings) corresponding to compression rate parameters, field/frame mode, color or monochrome, image spatial resolution (640.times.420 pixels, 320.times.240 pixels, for example), lens and camera adjustments, input selection where multiple cameras or video sources are used and the like.
According to embodiments, when an integrated communications device is used, such as by way of example, a cellular telephone, the telephone can be isolated from the rest of the system to permit independent use, and independent power up and power off and other cellular phone functions.
According to embodiments, in operation, a system permits not only the manual capture, dial (select) and send of images, but can also be fully automated to capture, dial and send, for example, on a timed sequence or in response to a sensor such as a motion sensor, video motion detection, or from a remote trigger device. The remote trigger also can be activated by an incoming telephone signal, for example.
In embodiments, a remote device can also be used for remote loading and downloading of firmware, and for setting of the programmable parameters such as to provide remote configuration of sampling modes during capture, compression rates, triggering methods and the like.
The triggering function penults a multitude of sampling schemes for a simple triggered activation for capturing an image upon initiation to a trigger signal to more complicated schemes for capturing and transmitting images prior to and after receipt of the trigger signal. The trigger function can be set to operate, for example, on a time per sample and number of sample basis, or time per sample and total sample time basis, or number of samples and total time basis. Depending on application, the trigger can sample in a prior to and after signal mode, using in combination the time per sample and number of samples prior and after signal basis, a total time basis, a percent prior versus percent after trigger basis, time per sample basis, time prior to and time after trigger basis, and other combination. For example, if the image capture device is positioned to monitor traffic accidents at a specific location, and an audio signal sensor identifying a crash were used as the trigger, it would be desirable to collect image sample both prior to and after the trigger signal. The number of samples, total sample time, and percentage of samples prior to and after trigger would be controlled by the specific application.
Circular sampling techniques are supported by a data capture system of the present discloser. This is particularly useful when triggering events are used to initiate transmission of collected image data over the communications system. For example, if a triggering event is motion detected at a motion sensor, it may be useful to look at the images captured for a period of time both prior to and after the actual event. The circuitry of subject embodiments permit any circular sampling technique to be utilized depending upon application, such as prior to an after trigger, only after trigger or only before trigger or prior to and after the trigger point. Again, as an example, it can be desirable to look primarily at images captured before a triggering event if the event is a catastrophic event such as an explosion or the like. Other circular sampling techniques can be employed, as well, incorporating multiple cameras, for example, wherein different fields are sampled depending upon the time frame in a sequence of events.
Embodiments provide an apparatus for capturing, converting and transmitting a visual image via standard facsimile transmission systems,
Embodiments provide au apparatus for compressing the visual image data in order to minimize the capacity requirements of the data capture and storage system.
Embodiments provide an apparatus for capturing and storing a visual image for later recall and review and/or transmission.
Embodiments provide an apparatus for storing a captured video image in digital format on a portable storage medium.
Embodiments provide an apparatus capable of sending and receiving telephonic audio messages, facsimile documents and captured visual images to and from standard, readily available remote stations.
Embodiments provide the means and method for capturing images prior to, prior to and after, or after a triggering event.
Embodiments provide for multiple triggering events and/or optional viewing or review of the captured images prior to printing or transmission.
Embodiments provide an apparatus which may be activated from a remote location for initiating the capture of images by the device.
Other objects and features will be readily apparent from the drawings and detailed description.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a basic facsimile camera configuration for capturing an image via a camera and transmitting it via Group III facsimile transmission to a standard hard copy medium.

FIG. 2 is similar to FIG. 1, but incorporates a memory storage capability, permitting storage and optional review or viewing of the image prior to transmission.

FIG. 3 is similar to FIGS. 1 and 2, but incorporates a data compression scheme for increasing the capacity of the memory and for increasing efficiency of transmission.

FIG. 4 includes the capture and transmission configuration of FIG. 2, with multiple transmission format capability including Group-III facsimile, personal computer, modem, parallel and serial transmission schemes.

FIG. 5 is an exemplary schematic diagram supporting the configurations shown in each of FIGS. 1-4.

FIGS. 6A, 6B, and 6C, are block diagrams of the physical components of desktop, portable and comprehensive console embodiments of the invention, respectively.

FIGS. 7A and 7B are perspective drawings of a hand held device for capturing, storing and transmitting an image in accordance with the invention

FIGS. 8A-1 through 8A-6, 8B-1 through 8B-6, 8C-1 through 8C-4, 8D-1 through 8D-30, 8E-1 through 8E-12, 8F, 8G, and 8L-1 through 8L-5, comprises a schematic diagram for an exemplary embodiment of the circuit for supporting the subject invention.

FIG. 9 is a diagram of the various triggering sequence options.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

According to embodiments, an image capture and transmission system captures either one or more single frame analog images or a digital images or image data or visual data or visual images, the aforementioned hereinafter being referred to as an “image” or “images”, and transmits a captured image in digital signal via any of a plurality of transmission schemes through a transmission interface such as, for example, cellular transmission, radio signal, satellite transmission, hard line telephonic transmission, or other transmission to a remote receiving station where the image is downloaded for viewing on a screen or printing on hard paper copy, a CRT screen image, or other medium. According to embodiments, a system is particularly well suited for sending and/or receiving images via a standard Group III facsimile transmission system and permits capture of the image at a remote location using an analog or digital camera. Two generic configurations are shown and described, the first, where each image is transmitted as it is captured, and the second, which permits capture, storage, and selective recall of captured images for transmission. Embodiments also contemplate a portable storage medium having the captured images stored thereon and which can be removed from the capture and transmission unit and archived for later use. While a system for black and white (gray tones) for Group-III facsimile transmission is described in detail herein, embodiments can be readily adapted to transmission of color images utilizing the teachings of the present disclosure using industry standard color video standards and circuits. Both portable, or hand held, image capture and transmission units and stationary, or desktop, image capture and transmission units are described. The circuitry utilized for both configurations is identical, but stationary configurations do not need a battery.
FIGS. 1-5 are circuit configuration diagrams for the various capture, storage and transmission schemes. The physical embodiments utilized to employ the teachings of the schemes taught in FIGS. 1-5 are not limited. FIGS. 6-10 are exemplary physical embodiments of the subject invention.
Turning now to FIG. 1, an embodiment incorporates an image capture device such as a standard analog or digital camera device 10 for capturing a visual image in the typical fashion. The camera 10 can be operator activated as indicated at 12, or can be programmed to be activated at selected intervals or in response to certain conditions. For example, a motion detector can be utilized to activate the camera 10 in a surveillance installation. Once activated, the camera 10 captures a visual image in typical fashion through a lens (see lens 192, for example, in FIG. 7 A). In the illustrated embodiment, the captured image is then transmitted to a gray scale bit map memory device 16, from which it is output to a half-tone conversion scheme 18 to be input into a binary bit map 20 for formatting the captured image in a configuration suitable for transmission via a Group-III facsimile system. The signal generated at 22 by the binary bit map 20 is input into a Group-III encoding and compression network 24 for generating an output signal at 26 which is introduced into a Group III protocol transmission device 28. The output at 30 of the transmission device 28 is then transmitted into any standard transmission interface such as, by way of example, hard line telephonic transmission, cellular transmission, radio signal, satellite transmission or other transmission system 32 via a modem or similar device, as needed (as diagrammatically illustrated at 29), to be received via a compatible interface by a remote Group-III receiving system 34. The Group III receiving system 34 is a typical Group-III facsimile system comprising a Group-III receiver 36, decoder and decompress or 38 and binary bit map 40, from which a facsimile hard copy such as plain paper copy 42 can be generated.
According to an embodiment, the above-described configuration is particularly well suited where near real time transmission is desired, for example when the system is operator controlled and a “real time” image is desired at a remote location. An example of such a system can be a photo identification confirmation of an apprehended suspect in law enforcement use, or transmission of images of damaged assets for insurance purposes, or transmission of images of construction job site conditions. This configuration is also well suited for use in those applications where a sensor activates the system and real time transmission of the sensed condition is desired. An example of such a system would be a motion activated camera in a surveillance location, where the image is immediately transmitted to a remote monitoring station. Of course, it will be readily understood by those who are skilled in the art that tagging a transmitted image with information such as, by way of example, date, time and location, can be incorporated in the transmitted signal so that a receiving station could monitor a plurality of remote image data capture systems. This is also useful for reviewing a body of previously stored or printed images to determine the time and location of such image.
The embodiment of FIG. 2 is similar to FIG. 1, but incorporates a memory and optional operator viewer system. The image is captured by the camera 10 and conditioned by the gray scale bit map 16, as in FIG. 1. In this embodiment, the output 44 of the bit map 16 is input into a standard digital memory device 46 for later recall. This configuration is particularly well suited for applications where near real time transmission of the image either is not required or is not desirable. It will be noted that with the exception of the insertion of the memory device 46 and the optional viewer device 48, the capture and transmission system of FIG. 2 is identical to that shown and described in FIG. 1. Once the image is captured by the camera 10 and is presented at 44 to the memory device 46, the image is stored for later recall and transmission. The specific type of memory device is optional and can include, for example, an SRAM device, a DRAM, Flash RAM, hard drive, floppy disk, PCMCIA format removable memory (see, for example, the PCMCIA card 72 in FIG. 7A), writeable optical media or other storage device. The memory can selectively capture images, as indicated by the operator interface/capture interface 52, or can be programmed to selectively capture periodic images or all images. In the embodiment shown in FIG. 2, an optional viewer device 48 is provided and permits the operator to recall and view all or selective images before transmission, as indicated by the operator interface/recall interface 54. The optional viewer device 48 permits the operator to review all images retained in the memory 46 and transmit selective images, as desired, to the Group-III transmission system. The remainder of the system of FIG. 2 operates in the same manner as the configuration shown and described in FIG. 1.
The configuration of FIG. 3 incorporates all of the features of FIGS. 1 and 2, and additionally, includes an interim data compression and decompression scheme to permit increased utilization of the memory or storage medium 46. As shown in FIG. 3, an interim format compressor 56 is inserted between the gray scale bit map 16 and the memory device 46. Insertion of the interim format compressor 56 between the gray scale bit map 16 and the memory device 46 permits compression and reduction of the data required to store the image, effectively increasing the capacity of the storage device or storage medium 46. Embodiments of the storage device or storage medium 46 can preserve the gray scale Quality of the image for viewing at the location of capture. An interim format decompression device 58 is inserted between the output of the memory device or storage medium 46 and the rest of the system, whether the optional viewer 48 is utilized, or the output is entered directly into the half-tone convertor 18. The interim compression/decompression scheme is particularly useful when all of the image data is to be permanently archived, or when limited capacity portable media are used, such as, by way of example, floppy disks or a portable PCMCIA card. It will be noted that the remainder of the system shown in FIG. 3 is identical to the system shown and described in FIG. 2.
FIG. 4 illustrates the use of the image capture and/or retention configured in any of the optional embodiments of FIGS. 1-3 and adapted for use in combination with any of a variety of transmitting and receiving schemes such as, by way of example, the Group-III system shown in FIGS. 1-3, a modem, direct connection to a personal computer, serial or parallel transmission, or any selected transmitting/receiving protocol. This illustration demonstrates the versatility of a system according to embodiments once the image has been captured, converted and conditioned by the image capture device of the disclosure. Specifically, once the image is captured by the camera 10 and conditioned by the gray scale bit map 16, it can be stored and transmitted, or transmitted “near real time” via any transmitting and receiving scheme. As shown in FIG. 4 the image capture device includes the memory device 46 and the optional viewer 48 for incorporating maximum capability. However, any of the schemes of FIGS. 1-3 would be suitable for producing a transmittable signal. In the embodiment shown, a format select interface switch 60 is positioned to receive the fully conditioned signal on line 59. The format select interface switch 60 can permit either automated or manual selection of the transmitting protocol, including the Group-[J] facsimile system previously described in connection with FIGS. 1-3, as indicated by selecting format select switch 60 position A; or PC modem protocol as illustrated by the JPEG compressor 62 and protocol generator 64, as indicated by selecting format select switch position B; or the wavelet compressor and PC modem protocol, as illustrated by the wavelet compressor 66 and PC modem protocol generator 68 by selecting switch position C; or any selected conversion network 65, (if needed) with a compatible compressor 67 (if needed) and compatible protocol generator 75 (if needed), as indicated by switch position D; or a serial protocol scheme 77, with serial drivers 79 directly to a hardwired personal computer 81 by selecting switch position E. Of course, it will be readily understood by those skilled in the art that one or a plurality of transmitting protocols can be simultaneously selected. Depending on the protocol selected, the signal output is generated at the selected output module and introduced to a communications interface module 83 via a modem or other device, as needed, for transmission via a transmission system to a compatible receiving station such as the Group-III facsimile device 34, the personal computer 85, the video telephone 89, and/or other server or receiving device 91 for distribution.
According to embodiments, an exemplary circuit supporting the configurations of FIGS. 1-4 is shown in FIG. 5. With specific reference to FIG. 5, an analog camera is indicated by the “video in” signal at 70. Typically, the video signal is a composite video/sync signal. The diagram shows all of the signal processing necessary to sync up to an NTSC signal 70 coming out of the analog camera and processed for introduction into an integral RAM memory 71 and/or a portable RAM memory via interface 73. An analog to digital (NO) converter 74 converts the video portion of the analog signal from the camera and produces the digital signal for output at line 76. The digital output data on path 76 is introduced into a data multiplexer circuit 81 a and into the RAM memory unit(s) 71, 72. In the exemplary embodiment, the portable RAM memory 72 is an image card such as, by way of example, a PCMC1A SRAM card or a PCMC1A Flash RAM card. However, it will be readily understood that any suitable RAM memory configuration can be used within the teachings of the disclosure. In an embodiment, it is desirable to store compressed rather than raw data portable memory in card 72 because of space and transmission speed factors.
As the signal at 70 is introduced into the circuit, the sync detector 78 strips the sync signal portion off of the video signal. The sync signal drives the video address generator 80 for providing a signal used to generate an address signal at the address multiplexer circuit 82 for synchronizing the scanned in video signal with the locations in RAM to define each frame to be captured. The read/write control 84 controls the coordination of the sync signal 93 with the video signal to define a full frame. Basically, when the camera is activated either by the operator or by automation, the system processor 86 detects the initiation of the camera and capture sequence and sends a signal via line 88 to the read/write control 84. The read/write control then monitors the incoming video signal 83 a to find the horizontal and vertical sync pulse to identify the beginning of a frame. The read/write control then initiates writing to memory at the RAM devices to initiate capture of the frame. The read/write control continues to “write” to memory until the appropriate sync signal is received, indicating the end of the frame. At this point a single frame is captured in RAM 71 and/or on the portable medium RAM 72.
This frame can now be output from the system via any of the available transmitting schemes. In the exemplary embodiment. the processor 86 can be any processor or such as a microprocessor or DSP, with sufficient capability to perform the described functions. The processor bus is indicated at 87. The circuitry supporting the processor comprises the processor chip 86 and the control store memory (ROM, Flash RAM, PROM, EPROM or the like) 92 for storing the software program executed by the processor. It will be understood that other memory devices can be utilized without departing from the disclosure. For example, a Flash RAM can permit flexibility and replacement of the program for upgrades and enhancements. The user interface commands are generated and interpreted by the software that is being executed by the processor 86.
The display unit 96 is connected through a typical interface 94, and provides a visual user interface at the camera body to give the operator a visual read-out of the status of the collection and transmission of a selected frame. In an exemplary embodiment. the display unit is a two line. multi-character LCD display, but other sizes or technology displays could be readily incorporated. depending, for example, on the amount of graphics desired in the display module. The bank of operator buttons and/or switches 98 are connected to the system through the button interface 100.
The general purpose control register 102 serves as a latch and permits control bits to be introduced from the processor 86 to the transmitting systems or to transfer status bits from the transmitting systems back to the processor in the well known manner. The modem 104 may be any of a variety of widely available modems or modem chip sets currently in commercial use. The modem should support CCITT Group-III fax format for transmission to Group-III fax machines. Once the signal is introduced into the modem 104, it is handled in typical fashion to provide input/output transmissions: (1) from the subject device to a hardwired telephonic line as indicated at 114, (2) from the subject device to the external facsimile machine as indicated at 116, or (3) Tom the subject device to an external wireless device telephone as indicated at 130. The specific selection is controlled by the user at button module 98 in conjunction with the processor 86.
An isolation transformer 110 is provided to isolate the circuitry connected to external communications circuit from the circuitry of the subject device. The relays at 108 and 112 permit patching directly into the hardwired telephonic line and to the telephone company system as indicated at 114, to an external handset or fax machine at 116, or to the modem 104, whereby facsimile data can be sent and received via the modem. These relays could be mechanical or solid state. The relay 118 is connected to a tone source 120 for providing an audible tone signaling to the user that the system is being used for transmitting or receiving a captured image.
With specific reference to the circuitry associated with relay 112, it will be noted that when the handset is switched away from the phone line to the tone source, the modem transformer 110 is switched to the telephone line 114. This blocks normal audio telephone service and permits the transmission of an image signal from the RAM devices 71 or 72, through the modem 104, and to the telephone line 114.
In the exemplary embodiment, a stand alone facsimile machine can be connected through the external handset jack at 116. With relay 112 set to activate telephone service and the tone generator 120 disconnected, the relay 108 can be set in either of two positions. The first position, as drawn, connects the facsimile machine at jack 116 to the telephone line, permitting standard facsimile transmission. The second or alternative position permits the modem J04 to transmit the image data signal directly to the facsimile machine at jack 116, for providing an archive copy or the like. In this configuration, the facsimile machine will operate as a local printer for printing the captured images. Signal source 120 may be used as a ringing voltage generator for signaling such facsimile machine prior to connection.
A system of the present [invention] disclosure also contemplates wireless transmission over a cellular telephone, radio frequency, satellite transmission or the like. In an exemplary embodiment, the specific configuration for a cellular telephone interface is shown in detail. The amplifiers 122, 124 amplify the input of the modern 104 and arc controlled by the FETs 126, 128, respectively. The FETs are controlled by the control register 102 and allow selection of the audio either coming in from the cellular interface 130 or from the telephone line 104 to the modem. This permits the cellular phone to be used for three distinct functions: (1) as an audio telephone, (2) as a transmitting system for transmitting the captured image and related signals via a cellular system, and (3) for receiving incoming transmissions to the processor. such as remote control, remote configuration or images.
In the exemplary embodiment, the image card 72 is a DRAM card or non-volatile storage card such as a Flash RAM or the like and provides a removable medium for storing the image data as either raw or compressed data. The card can also be used to store compressed data sent into the system via external facsimile transmission. As illustrated. the system is capable of both sending and receiving image data via Group-III fax or other protocol. By incorporating the digital to analog (D/A) converter into the system and pulling the signal from the RAM 71 (or portable RAM 72), the signal can be displayed right at the camera viewfinder 134 or other display device connected at port 138. A sync generator 136 is incorporated to provide synchronization of incoming data in the same manner. The sync detector 78 is utilized to define a frame-by-frame 1 correlation of the data generated by the camera at the video input 70 for storage to memory 71 or 72.
Any standard power source may be utilized, including replaceable or rechargeable batteries 141 or an AC adapter 142. The AC adapter is particularly suitable for desktop applications.
The exemplary embodiment includes a speaker or other audio transducer 144 for emitting a detectable signal whenever the user interface merits its use, such as user induced errors, system errors, user attention getting and the like.
In order to send a facsimile transmission over a typical Group-III Facsimile system, the multiplexer 82 is switched to the processor 86 such that the RAM address is generated by the processor 82 instead of the video address generator signal. In the facsimile transmitting mode, the processor accesses the RAM and manipulates the data representing each frame image. For example, the processor will perform the gray scale to halftone conversions described in connection with FIGS. 1-4 to prepare the signal for facsimile transmission. The processor can also perform image compression and output the image as a gray scale. In the facsimile transmission mode, once the half tone conversion is completed; the processor executes a code for performing a bi-Level compression of the data and the signal representing the frame data is output over line 90. through the multiplexer 81 a and over the processor bus 87 to the processor 86, then to modem 104 for transmission. Other memory and processor configurations could be used without departing from the scope and spirit of the invention, as will be recognized by those skilled in the art.
Various physical configurations of embodiments are shown in FIGS. 7A & 7B. FIGS. 6A. 6B and 6C are block diagrams for desktop and portable units. FIGS. 7A and 7B illustrate embodiments as incorporated in a standard 35 millimeter type camera housing.
A basic desktop system according to embodiments is shown in FIG. 6A, and includes a console unit having a telephone jack 152, an external telephone connection 154 and a video input/camera power jack 156 for connecting the analog camera 10. A facsimile machine can also be connected at jack 154 to provide local printer capability. The configuration shown in FIG. 6B is a basic portable system. with a battery powered portable module 160 having a self-contained power source 162. The system can include an integral RAM and/or the removable memory module as indicated by the image card 72. The camera 10 can be an integral feature of the portable module 160, or may be a detached unit, as desired. In the illustrated embodiment, a cellular telephone 164 is provided with a data jack 166 for connecting to the output jack 168 of the module, whereby the image data signal can be transmitted via the cellular telephone to a remote facsimile machine over standard cellular and telephone company facilities. When incorporating the circuitry of FIG. 5, the cellular phone can be used as both an input and an output device, and incoming data or stored images can be viewed through the viewfinder 170.
FIG. 6C shows a comprehensive desk or stationary configuration incorporating all of the features supported by the circuitry of FIG. 5. As there shown, the control module 172 is adapted for receiving the image card 72 and is powered by an AC power adapter as indicated at 142. The camera 10 is connected to the module via a hardwired connection at jack 174. A monitor 176 is provided for viewing data images. A video cassette recorder 178 is provided and may be used as an auxiliary input device for the images transmitted from the system. The facsimile machine 180 can be used as a local printer, or can be used to send facsimiles transmissions in the well-known manner. Direct connections to the telephone line system are provided at jack 182. The FAX/phone jack 186 can be connected to a facsimile machine 180 and/or a standard telephone 184, where the public telephone system can be accessed. A data jack 188 is used to connect to a cellular telephone or the cellular modem, or other wireless device for transmission or reception of image data.
According to the embodiment illustrated in FIGS. 7A and 78, the camera body 190 is similar to a standard 35 millimeter camera housing and is adapted to receive a standard lens 192 with a viewfinder 194. The electronics are housed in the casing in the area normally occupied by the film and film advancing implements. The operator interface button keys 98 are housed within the housing and can be positioned on the back plate 196 of the body. FIG. 8, The LCD unit can be positioned to be visible through the viewfinder 194 or can be in a separate back window 198. The memory card 72 is positioned in a slot 200 provided in a sidewall of the camera body. In the illustrated embodiment, camera body 190 has the appearance of a standard SLR 35 millimeter camera. In addition, where desired, an integral cellular phone can be incorporated in the camera housing and transmission can be sent directly from the camera housing to a remote receiving station. The keypad for the telephone is indicated at 202.
FIG. 8 is an illustration of an exemplary schematic diagram for the circuit of a system according to embodiments as specifically taught in the diagram of FIG. 5. Pin numbers, wiring harnesses and components are as shown on the drawing. FIG. 8, part A, is the system interconnect and shows the central processor board 300, the video board 302, the power board 304 and the CRT electronic interconnect board 306. The (telephone interface is provided at 307. Board 308 is the audio connector board. Board 310 is the serial connector board and board 312 is the video connector board. FIG. 8, part B contains the audio logic, with audio 110 at 314. The audio amplifiers are designated 316 and 318. A microphone connector is provided at 320. with preamplifier circuit 322. Audio switches are provided at 324 and 326. Summing circuit 328 provides audio summing. The serial RAM for audio is designated 330. FIG. 8, part C includes the camera module 332 and the camera control digital to analog convertor 334. Amplifier 336 is the video buffer. Module 338 is the camera shutter control resistor.
FIG. 8. part D contains the central processor unit 340. Voltage in is at 342. with the power switch at FET 344. Power shutdown is provided at the video shutdown bit 346. The video connector is designated at 348. Pin I is switched five volts out to video logic. Pins 2-9 are connected to the video data bus and pins 10-22 are video control signals. Buffers 350 and 352 are the video board I/O isolation buffers. As shown, pin 19 of buffer 352 is the output enable and are connected to the video shutdown bit 346. Line 354 is bus enable. Pin AO of buffer 350 is the direction control signal and pins AI A7 are connected to the processor data bus. Pins 10-17 of buffer 352 are also connected to the processor bus.
The system DRAM memory is designated 356. The processor 110 module is designated 358 and the 110 decoder is provided at 360. A non-volatile RAM 362 provides system parameters. The processor oscillator is shown at 364 and a real time clock at 366. Controller 368 is the RAM card controller. The PCMCIA socket for the RAM card is shown at 370 a and 370 b. The modem is designated 372. The serial controller is shown at 374 with serial controller oscillator 376. Module 378 is a memory module. A signal buffer is provided at 380, and an address decoder at 382. Connectors are designated at 384, 386 and 388.
FIG. 8, part E shows the modem hoard connector at 390, the glue logic PLD at 392 and the glue logic module at 394. Module 396 is the synchronous/asynchronous serial controller. Circuit 398 is the signal multiplex relay and circuit 400 is the transmit/PTT relay. Bypass relays are shown at 402. Relay 404 is the digital mode relay. Transformer 406 is the audio isolation transformer. Circuit 408 provides a low speed data filter. The line drivers are designated 410 and the line rectifiers are designated 412, respectively. Connector 414 provides radio/serial data connection.
FIG. 8, part F shows the status LED's 416 and the PCMCIA door open switch 418. FIG. 8, part G shows the power switches 420. FIG. 8, part H is the battery pack 422.
FIG. 8, part L shows the push button control switches as 490 and 492. The keyboard display is designated 494, and the microcontroller 496 is the keyboard and keyboard display microcontroller. The backlight circuitry is designated at 498, with the back light control at 500. Module 502 is the LCD module.
The circuitry supports any of the configurations such as, for example, a basic near real time transmission system via Group-III fax or a comprehensive system supporting both land line and wireless transmission of image, audio and documentary data at both a local and remote station.
Embodiments permit digitized collection of audio signals through the use of an internal microphone, and external input device, a cellular telephone, land line telephone, wireless radio or other communication system, and digitized audio playback, as well. The playback can be via an internal speaker, out an external out jack to a remote device or via a cellular telephone, land line telephone, wireless radio or other communication system.
The digitized image and audio capture features permit association of audio with an image, as well as data with the image. Useful data associated with the image includes GPS from either internal or external GPS devices, date and time, and text which may be input from an integrated keyboard or from a remote location.
According to the embodiments, a system supports storage of images in an interim storage format including raw video, interim gray scale format and/or half tone format. The image can also be stored in the selected output mode, such as by way of example, a Group III facsimile mode. The versatile capability of the system permits transmission of captured data to a standard bi-level facsimile machine such as Group III, to gray scale facsimile systems or full color facsimile systems, as well as to other remote receiving devices such as, by way of example, personal computers and network servers. The data can be transferred in any of a variety of formats and protocols including JPEG, FAX, emerging imagery fondants, wavelets and data protocols. Embodiments are adapted to operate in multiple modes, with a unitary capture and send mode or separate capture and store, and send modes. In an embodiment, the system is adapted for tagging a collected image, video, audio, and other data such as a GPS signal, with a real time clock and added text. This permits the complete historical data to be transmitted simultaneously with the image signal.
It is contemplated that a system according to embodiments can be self-contained with an integral power unit such as a rechargeable battery source or the like. Therefore, the system can be adapted to power up when in use and power down when not activated, preserving power during idle time. The power systems for the video camera, the video input circuits and converters, the modem or other transmission devices and other high drain components can be isolated and only powered when needed. This also permits use of ancillary functions, such as use as a cellular telephone, to proceed without draining the power source by powering idle components. The processor clock rate can also be slowed down during idle mode to further conserve power.
Where desired, a system according to embodiments also includes camera operation control capability through the use of a digital Vanalog network for converting digital commands to analog signals for controlling the gain, pedestal, setup, white clip, lens focus, and other functions of the camera from a local input device, a remote device or as programmed functions. The central processor can also be used to control camera shutter rate. Camera features and parameters which can be controlled in this manner are compressor resolution (high, medium, low), field/frame mode, color or monochrome, image spatial resolution (640.times.430, 320.times.240, for example), lens and camera adjustments, input selection where multiple cameras are used and the like.
When an integrated communications device is used, such as by way of example, a cellular telephone, the telephone can be isolated from the rest of the system to permit independent use, and independent power up and power off and other cellular phone functions.
In operation, a system according to the embodiments permits the manual capture. dial (select) and send of images and can also be fully automated to capture. dial and send, for example. on a timed sequence or in response to a sensor such as a motion sensor or from a remote trigger device. The remote trigger can be activated by an incoming telephone signal, for example. The remote device can also be use for remote loading and downloading of firmware. and of the programmable devices. as well as to provide remote configuration of sampling modes during both the capture and the send functions.
Circular sampling techniques are supported by a data capture system according to embodiments. FIG. 9 is a diagram illustrating exemplary sampling techniques in accordance with the teachings of the disclosure. As shown in FIG. 9. the time sequence is indicated by the Time Line: t1 . . . t2 . . . tn. with a sample at each time interval. as indicated by S I . . . So. For purposes of illustration. the triggering event occurs at time interval t 10. Based on the predetermined programming of the system, images will start to be collected upon triggering event. as shown at 210, for a predetermined period prior to and after trigger. as shown at 212, or immediately preceding the trigger, as shown at 214. This permits “circular image storage” without requiring that all images be collected and stored in order to look at events surrounding a triggering event. Circular sampling techniques are also very useful when multiple overlapping zones are monitored by multiple devices and it is desirable to sequence from device to device without losing any critical images.
Circular sampling techniques are particularly useful when triggering events are used to initiate transmission of collected image data over the communications system. For example, if a triggering event is motion detected at a motion sensor, it may be useful to look at the images captured for a period of time both prior to and after the actual event. The circuitry of embodiments permits any circular sampling technique to be utilized depending upon application, such as prior to an after trigger, only after trigger or only before trigger. Again, as an example, it can be desirable to look primarily at images captured before a triggering event if the event is a catastrophic event such as an explosion or the like. Other circular sampling techniques can be employed, as well, incorporating multiple cameras, for example, wherein different fields are sampled depending upon the time frame in a sequence of events.
Other configurations are contemplated and are within the teachings of the disclosure. While specific embodiments have been shown and described herein, it will be understood that the invention includes all modifications and enhancements within the scope and spirit of the claims.

Claims

What is claimed is:

1. An image data capture system, comprising:

a housing configured for being held within a hand of a user;

a camera mounted on the housing and configured for collecting visual image information;

image processing circuitry within the housing, wherein the image processing circuitry is coupled to the camera, wherein the image processing circuitry is configured for enabling the visual image information to be selectively retrieved from a digital memory device and wherein the image processing circuitry includes a transmission protocol selector enabling a visual image signal comprising the visual image information to be selectively processed in accordance with a plurality of transmission protocol modes; and

cellular telephone circuitry within the housing, wherein the cellular telephone circuitry is coupled to the image processing circuitry and is configured for enabling visual image information to be wirelessly transmitted for reception by a remote receiving device after being processed by the image processing circuitry.

2. The image data capture system of claim 1 wherein:

a first one of the transmission protocol modes is a modem transmission protocol mode; and

a second one of the transmission protocol modes is a serial transmission protocol mode.

3. The image data capture system of claim 1 wherein:

the image processing circuitry includes one or more compressors; and

the visual image information is provided to the one or more compressors when the transmission protocol selector designates selection of a modem transmission protocol mode.

4. The image data capture system of claim 1 wherein:

a first one of the transmission protocol modes is a transmission protocol mode that causes the visual image information being compressed in accordance with a JPEG (Joint Photographic Experts Group) compression algorithm; and

5. The image data capture system of claim 4, further comprising:

a serial interface connected to the image processing circuitry;

the visual image information is provided to the cellular telephone circuitry when the transmission protocol selector designates selection of the transmission protocol mode that causes the visual image information being compressed in accordance with the JPEG compression algorithm; and

the visual image information is provided to the serial interface when the transmission protocol selector designates selection of the serial transmission protocol mode.

6. An image data capture system, comprising:

a housing configured for being held within a hand of a user;

a camera mounted on the housing;

a digital memory device coupled to the camera for receiving visual image information collected thereby;

a serial interface;

cellular telephone circuitry within the housing, wherein the cellular telephone circuitry is configured for enabling the visual image information to be wirelessly transmitted for reception by a remote receiving device; and

image processing circuitry within the housing, wherein the image processing circuitry is coupled to the cellular telephone circuitry, the serial interface and the digital memory device, wherein the image processing circuitry is configured for enabling the visual image information to be selectively retrieved from the digital memory device and wherein the image processing circuitry includes a transmission protocol selector enabling a visual image signal comprising the visual image information to be selectively provided to the cellular telephone circuitry after being processed in accordance with a modem protocol and provided to the serial interface after being processed in accordance with a serial transmission protocol.

7. The image data capture system of claim 6 wherein:

the image processing circuitry includes a JPEG compressor and a protocol generator connected to the JPEG compressor; and

processing of the visual image signal to provide the transmission protocol configured instance of the visual image information is performed by the JPEG compressor and the protocol generator.

8. The image data capture system of claim 6 wherein:

the image processing circuitry includes an interim format compressor, an interim format decompressor and an image viewing device;

the interim format compressor is connected to the camera for receiving the visual image information therefrom and to the digital memory for enabling the visual image information generated by the camera to be provided in an interim compressed format within the digital memory;

the interim format decompressor is connected to the digital memory for enabling a visual image defined by the visual image information to be viewed on the image viewing device in an uncompressed format and to be provided to the image processing circuitry in the uncompressed format; and

the digital memory is connected to the an output portion of the image processing circuitry for enabling the visual image information to be accessed therefrom and to be selectively outputted from image data capture system in accordance with the modem protocol and the serial transmission protocol.

9. A handheld information communication and image processing system comprising:

a camera;

an image viewing device;

cellular telephone circuitry within the housing, wherein the cellular telephone circuitry is configured for enabling visual image information to be wirelessly transmitted for reception by a remote receiving device; and

image processing circuitry within the housing, wherein the image processing circuitry is coupled to the cellular telephone circuitry, the image viewing device, and to the camera, wherein the image processing circuitry includes a digital memory, an interim format compressor, an interim format decompressor, wherein the image processing circuitry is configured for enabling the visual image information to be selectively retrieved from a digital memory device, wherein the interim format compressor is connected to the digital memory for enabling the visual image information to be provided in an interim compressed format within the digital memory, wherein the interim format decompressor is connected to the digital memory for enabling a visual image defined by the visual image information to be viewed on the image viewing device in an uncompressed format and to be provided to the image processing circuitry in the uncompressed format, wherein the image processing circuitry includes a transmission protocol selector enabling the visual image information to be selectively processed in accordance with a plurality of transmission protocol modes.

10. The handheld information communication and image processing system of claim 9 wherein:

11. The handheld information communication and image processing system of claim 9 wherein:

12. The handheld information communication and image processing system of claim 9 wherein the visual image information is provided to the image processing circuitry in a state of compression dependent upon a transmission protocol mode designated by the transmission protocol selector.

13. The handheld information communication and image processing system of claim 12, further comprising:

a communications interface, wherein a first one of the transmission protocol modes is a modem transmission protocol mode and wherein the visual image information is provided to the communication interface after being processed in accordance with a serial transmission protocol.

14. The handheld information communication and image processing system of claim 12 wherein:

the image processing circuitry includes a JPEG compressor; and

processing of the visual image signal to provide the transmission protocol configured instance of the visual image information includes compression of the visual image information by the JPEG compressor.

15. The handheld information communication and image processing system of claim 14, further comprising:

a serial interface, wherein a second one of the transmission protocol modes is a serial transmission protocol mode, and wherein the visual image information is provided to the serial interface after being processed in accordance with a serial transmission protocol.

16. The handheld information communication and image processing system of claim 15, further comprising:

a housing configured for being held within a hand of a user, wherein the camera, the image viewing device, the cellular telephone circuitry, the image processing circuitry, the communication interface, and the serial interface are all mounted on the housing.

17. A handheld image data capture system, comprising:

an image data collection device;

a serial interface;

a communication interface;

image processing circuitry coupled to the image data collection device, the serial interface and the communication interface, wherein the image processing circuitry is configured for enabling the visual image information to be selectively retrieved from a digital memory device of the image processing circuitry, wherein the image processing circuitry includes a transmission protocol selector enabling the visual image information to be selectively processed in accordance with a modem protocol and a serial transmission protocol, and wherein the visual image information is provided to the communications interface after being processed in accordance with the modem protocol and is provided to the serial interface after being processed in accordance with the serial transmission protocol; and

cellular telephone circuitry coupled to the communications interface, wherein the cellular telephone circuitry is configured for enabling visual image information to be wirelessly transmitted for reception by a remote receiving device after being processed by the image processing circuitry.

18. The handheld image data capture system of claim 17, further comprising:

a housing configured for being held within a hand of a user, wherein the image data collection device, the serial interface, the image processing circuitry, and the cellular telephone circuitry are at mounted on the housing.

19. The handheld image data capture system of claim 17 wherein:

the image processing circuitry includes one or more compressors; and

the visual image information is provided to the one or more compressors when the transmission protocol selector designates selection of the modem transmission protocol mode.

20. The handheld image data capture system of claim 17 wherein:

the interim format compressor is connected to the image data collection device for receiving the visual image information therefrom and to the digital memory for enabling the visual image information generated by the image data collection device to be provided in an interim compressed format within the digital memory; and

the interim format decompressor is connected to the digital memory for enabling a visual image defined by the visual image information to be viewed on the image viewing device in an uncompressed format and to be provided to the image processing circuitry in the uncompressed format.

21. The handheld image data capture system of claim 17 wherein the visual image information is provided to the image processing circuitry in a state of compression dependent upon a transmission protocol mode designated by the transmission protocol selector.

22. The handheld image data capture system of claim 21 wherein:

23. The handheld image data capture system of claim 22 wherein:

the image processing circuitry includes one or more compressors; and

24. The handheld image data capture system of claim 23, further comprising:

a housing configured for being held within a hand of a user, wherein the serial interface, the image processing circuitry, and the cellular telephone circuitry are at mounted on the housing.