CA1209689A - Omnispectravision - Google Patents

Abstract

ABSTRACT
A system for providing a visual color display of multi-spectral and/or multi-sensor data particularly that provided by a trichroic infra-red scanning system, which includes the assignment of visible color signals to such data in a manner to maximize color discrimination of the viewer and allows the use of a conventional color display, particularly a CRT, to produce a real time color picture of the image that the data represents.
The system includes several color guns each of which is capable of producing a beam current, with at least one gun for each primary color to be displayed.
Several operational amplifiers, each corresponding to a respective one of the guns is provided, each amplifier having an input capable of receiving a video signal which corresponds to the infrared signal and an output.
A feedback loop is connected between the output and the input of each operational amplifier respectively, incorporating in the loop a single color gun which is driven as a feedback element of said amplifier, a result of which is the production of a beam current by each gun which varies linearly as the video signal to the amplifier varies during image production.

Description

~Q9~89 This is a divisional of copending Canadian patent application Serial No. 379,101 filed on June 5, 1981, inventor John Joseph Stapleton.
The present invention relates to a system which is capable of providing an improved visual display of spectral data.
There is presently provided numerous devices for displaying data ~ icll is based upon radar, infrared scanning, laser verification, etc.
Tllese may utilize cathode=ray tubes (CRT~ or other display means which would provide image reproduction that can be monitored by a viewer.
In many applications, i.e., military, medical, environmental, etc., it is ~esirable, if not imperative, that a real time display of the ` image by provided which allows a human operator to effectively detect and recognize targets or items.
At low spatial frequencies, the chromatic response of the operator exceeds the achromatic response so that certain images which are indistinguishable in a monochrome display, would be discernable in a color display. For example, often it is necessary to distinguish a temperature variation of .1K within a 300 background which would be impossible in a monochrome arrangement.

12~ J.J. Stapleton-l Accordingly, it is advantageous to utilize pseudo or false color to discriminate multi-sensor data. ~Ihile pseudo colors have been utilized in non-real time applications i.e., Landsat and ERT satellites mapping an original color or infrared imaye described by perhaps primary colors i.e., Red, Green, and in-frar~l, it does not provide a real time display of linear functions of spectral signatures of the image.

While the use of digital scan conversion of such data for CRT displays would be advantageous, the use of conven-tional long persistent PPI or CRTs in conventional operationalcircuitry in displaying such data as pseudo-colors is limited.
Present high resolution scan or image conversion and color dis-pla~ utilize costly cosmetic colors for manual modes of operation and usually make color cues as to possible targets questionable L5 and often distracting.

In addition, sin~e present infrared sensors, particularly that of the trichroic, multi-discriminant processing type, scan at high speeds, refresh electronics and memory is necessary to a read out at a T. V. frame rate to enable the operation to detect taryets and to continually update the data displayed. Conventianal color CRTs and video amplifier arrangements are ineffective in providing such displays and color code assignments in such arrangements would be diluted, decreasing their effectiveness.

SUMMARY OF TEIE INVBNTION

Accordingly, it is an object of the invention to provide for a real time visual display of image data, particu]arly that relative to the infrared.

It is a further object to provide a digital color assignment of such image data which is weighted to maximize the ability of the operator to discriminate the e~istence of SOUg]lt after targets.
It is a yet further ob~ect to provide for such a visual display of image data ~ ich may utilize conventional CRTs.
The present invention involves the utilization of color assign-ments or image data to display a color image. I~ile the color assignments may readily incorporate a wide variety of data sources, i,e., laser returns, radar, TV camera signals etc., the discussion will use as an example the trichroic system of image scanning which provides pulses which correspond to infrared wavelengths or bands of the image being scanned. However, it should be noted that all multi-sensor data may be digitized and displayed.
In a trichroic system operation there is usually provided the spectral separation of incident radiation into three spectral bands, each o ~ ich may be detected by a single detector in time sequence. The pulse output of the system may be in the form of a composite pulse and two sequen-tial pulses corresponding to the lnfrared image and may be used in image processing and reproduction. Omnispectravision categorizes the ratios of the irradiance of three infrared wavelengths, and preferably assigns the subtractive colors - Red, ~cyan) - Green (magenta) and - Blue (yellow) (hereinafter sometimes referred to as RGB) to the wavelengths to determine the presence of targets that are readily recognizable in a large field of view. Cool ~300k) backgrounds would be cyan, solar ~6000k) clutter would be yellow, with midband target recognition maximized with magenta. This is done to optimize the discrimination of the visible colors of the CRT to the IR signals, and to provide a digital signal for each wavelength which is weighted for optimization.

J.~. Stapleton-l The device serves to provide a digital signal which is utilized in a pixel by pixel mapping in real time of an originally invisible image which can be described by the three wavelengths or with multi-sensor data sets of multispectral or multisensor i image planes of the same scene, to a visible color space defined by the display tristimulus values that are linear functions of the original image pixel value. This pixel by pixel mapping can be used in a color display which may be of the CRT type, however, unlike conventional CRT's, has unity gamma and color stability derived .0 from the use of transconductance amplifiers r having the CRT as a ~eedback element.

In this regard, the transconductance amplifiers produce b~am currents which are proportional to the input video voltage by driving the CRT grid and cathode within a feedback loop. Hence, the gamma is approximately unity, whereas, conventional color CRT
gamma is 2.5. (Light output is proportional to the 2.5 power of input video voltage~. Linearity or operation thus conforms to ~Grassman's rules of color and thus the color contrasts displayed are discerned as ratios since the eye-brain takes the logarithm of 'O the difference signals (Log A-Log B = Log A/B).

Accordingly, the device provides a means of displaying a color image data utilizing a conventional CRT which is responsive to a color coded digital input, repeatable and subject to refresh memory, without dilution of color assignments. This digital input '5 of the coded colors, which are weightea to provide an i~proved discernable difference between the colors assigned, serves to optimize viewer recognition of a target even in cluttered background and at low spatial frequencies.

31LZ~9~09 According to a broad aspect of the present invention, there is provided a device for displaying multi-sensor or multi-spectral data which is in ~he form of video signals corresponding to said data, as an image, said device comprising: at least one gun capable of providing a beam current; an operational amplifier for said gun having an inputJ capable of receiving a video signal, and an output; a feedback loop connected between the output and input of said operational amplifier incorporating in said loop said gun and driving said gun as a feedback element as a result of which is the production of a beam current by the gun which varies linearly as the video signal to the amplifier varies during image production.

-~a-J.J. Stapleton-l BRIEF DESCRIPTION OF THE DRAWINGS

The above mentioned and other features and objects of this invention will become more apparent by reference to the following description taken in conjunction with the accompanying S drawings~ ~

Figure 1 is a graphic display of a chromaticity diagram in which the X and Y chomaciticity coordinates are plotted in rectangular coordinates for the present invention.

Figure 2 and 3 are curves o~ waveforms illustrating 1~ a spec~rally multiplexed signal of a trichroic scanning system shown in a time sequence overlap for a single and double target respectively.

Figures 4 and 5 are schematic representations of logic arrangements to unblank the CRT during operation incorporating the teachings of the invention.

Figure 6 is a simplified schematic representation of a CRT contained as a feedback element of an operational amplifier incorporating the teachings of the invention.

Figure 7 is a detailed schematic representation of Figure 6.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
_ The present invention proposes the assignment of false or pseudo color to multi~spectral data to maximize discrimination of the viewer to the presences of targets. This i5 in particular regard to spectral data received from infrared scanners utilizing a trichroic system. As aforementioned, a trichroic system usually provides a composite pulse with two sequential pulses relative to the particular infrared wavelengths of the image, for image processing and repro-duction. (See for example figures 2 and 3 later discussed) - ~2a~
J.J. Stapleton-l To provide for maximization of the presence of targets, the infrared wavelength dispersed by the trichroic system are assigned a particular color which is digitally coded and weighted arbitrarily in a manner unrelated to the actual wavelength, for optimization.
These color assignments maximize the hue and therefore the maximum discrimination of the viewer. In this regard, maximum discrimination can be found in hue along the bottom portion of a standard Kelly chart or in the -Green or magenta region. ~ccordingly, it has been found advantageous for color discrimination and in view of standard 0 color codes to assign the subtractive colors - R, - G, and - B to the trichroic wavelengths or bands l~

The false or pseudo colors are utilized since color differences are more noticeable than achromatic displays especially at low spatial frequencies. Without brightness or contrast S adjustments, there can be displayed 32 linear levels of luminance (phokopic brightness) of each primary RGB, so that (25)3 or 32,76~ different shades are digitally addressable from one 15 bit word. While this 90 db dynamic range will be degraded by observer conditions, it can still provide 72 db dynamic i.e., 4096 digitally 0 addressable colors, that are noticeably different.

The present system serves to categorize the ratio of the three infrared wavelengths of the system to determine the presence of target and optimize~the discrimination of the colors RGB of the CRT by utilizing a weighted digital coding of the colors.
~5 In this regard, a weighting of RGB in a ratio of 2/4/1 respectively had been found effective in displaying the presence of a target with the color red arbitrarily chosen as indicating the sought after target.

~Z~6~
J.J. Staple-ton-l To provide such digital coding, a weighted hexadecimal color-code cube was utilized, following the color code configuration of Maxwell, and numerically controlled by a computer to display the 4096 bits of information for each picture element. The hexa-i decimal color code divides the luminance contribution of eachadditive primary into 16 luminance levels producing equa~ steps measurable by a photopic spot brightness meter and due to the

2/4/1 weighting of the RGB, each code algebratically specifies the color and brightness and allows their simple addition and ~0 subtraction.

Each color of the 4096 bits is uniquely specified herein by only three hexadecimal alpha numerics ~ith RGB weighted in terms of the CIE color coordinates tgraphically illustrated in figure l with the point values shown by their X & Y coordinates) of the RGB
.5 phosphors or primaries, such that the composite (vector sum) of two primaries is in line with the complement of the third primary. In particular, the complement of green (i e , magenta) is assigned to the predominant wavelength of the target as shown in the figure to optimize the visible hue variation as the intensity ratio of ~ " ~
'0 ~ change. The use of this technique allows vector addition and subtraction of colors and allows the operator eye-brain combination to perform color ratio discrimination.

With regard now to Figures 2 and 3 there is shown wavelengths or time sequence pulses in an 18 mr dispersion provided by the trichrG:
'5 scanning system. As shown a composite (3-5 um) pulse designated Gold and two sequential pulses designated - Blue and - Green referring to ~, and ~ L respectively are provided and with the use of in-expensive analog codification and a digital delay line there may be produced a full color, flicker ~ree display of the spectral and spatial signatures. In this regard, since a digital delay line i.e., from a CCD, or a RAM, is used for flicker free operation, a video output is provided which may readily be tapped in order to overlap the three sequential pulses.

~2091~
J.J. Stapleton-l As aforementioned, the visible colors of the CRT, (or any other type display) are assigned to the trichroic infrared signals to optimize the discrimination ratio and speed of recognition , by the viewing operator. Subtractive colors - R, - G, and - B are ; assigned to infrared wavelengths ~3~ respectively, which i, indicated i the Figures. The signals from each of these are applied to the respective CRT provided for each of the colors as later discussed.

In Figures 2 and 3 each of the pulses or signals corresponding to ~ and the composite signal (Gold) (corres-!O ponding to white~ are shown in a time sequence as video readoutsfrom a RAM or other digital delay. The signals or pulses for each ~ and Gold are sychronized by the delays in the memory that correspond to the spatial dispersion of the scanner and allows ~or the s~ignals or pulses to be overlapped for each pixel production a~d the determination of the pulse for ~3 to control the r~d gun as hereinafter discussed.
In Figure 2, the waveform A represents the positive pulse or signal corresponding to wavelength ~ assigned the color - G at a point in time arbitrary designated To and shown by 'O the phantom box which represents 1 mr resolution. This signal regulates the green gun in the CRT at To.

At a delay of 6 mr, the waveform B shows the ti~e sequence position of the pulse or signal corresponding to wavelength ~l assigned the color - B, which is positioned to be overlapped with '5 that of - G as will be discussed. This signal regulates the blue gun of the CRT at To.

At a delay of 18 mr, the waveform C shows the time sequenced position of the puLse or signal corresponding to the composite Gold, which is positioned to be overlapped with that of - G and - B as shown.

~09689 J.J. Stapleton-l By the sychronization of the pulses or signals for the composite Gold, ~ ~ and ~ , , the signal or pulse for ~ 3 which controls the red gun, may be determined by essentially sub-tracting the pulse for ~ L and/or ~ ~ , depending if both or just one is present, from the composite pulse, leaving the signal for as shown in waveform D.

This subtracting of the ~ and/or ~I from the composite pulse may be effected by applying the signal corresponding to ~ ~
and ~ to the inverting i~put of the operational amplifier arrange-.0 ment shown in figure 7, while applying the signal corresponding tothe composite pulse to its non-inverting input as will be later discussed~ Negative values would be clipped as shown in wave~orm D o figure 2.

With regard to igure 3, this is similar to figure 2 in all respect with the exception of now depicting two targets, T
and Tl'with the pulses or signals for each.

The 1 mr resolution is maintained by blanking in the absence of a composite pulse and a pulse corresponding to - Blue and/or - Green. Otherwise, transversal filtering for example would `0 double the blur in azimuth rather than reducing the chrominance confusion, from 18 mr to 1 mr. Spectral shifts can only now occur when the pulses overlap exactly within the 18 mr dispersion.

Accordingly, in operation only when the wavelengths and/or,~, are present and overlapped with the composite pulse ~5 for the determination of ~S , all three of whi~h designate the pixel characteristics, are the grids of the CRT unblanked to allow color production of the pixel.

_ g _ ~2~9~ 9 J.J. ~tapleton-l The coordination of the unblanking ~ay be effected by the logic circuits shown in figure 4 and 5 which corresponds to analog or digital pulse inputs respectively, whichever is desired.
In this regard, figure 4 provides an analog logic circuit wherein analog pulses corresponding to - Green and - Blue may be applied at the non-inverting inputs of comparators 10 and 12 respectively. The inverting input of compar~ators 10 and 12 may together or separately have a voltage placed thereon to provide a threshold level which may be ~aried as desired so as to eliminate noise etc.
~0 Similarly, the comparator 14 is provided to receive the composite or Gold pulse at its non-inverting inpu~ with a threshold level capable of being regulated by a voltage placed at its non-inverting input as desired.

The output of the comparàtors 10 and 12 is fed to NOR
~5 gate 16, whose output connects to an input of AND gate 18. The output of comparator 14 connects also to the input of gate 18, with the results that only if a - Green, and/or Blue pulse is present at comparitor 10 or 12 and a composite pulse is present at comparator 14 does a positive output appear at 20.
'0 This output pulse at 20 is then applied to the CRT
control grids for each of the colors which regulates operation of the grids,coordinating the beam currents from the guns of a conventional CRT,as later discussed,so that all the colors for the particular pixel are produced at the same point in time to provide '5 efective pixel by pixel mapping.

Similar unblanking can be provided by the logic circuit shown in figure 5. iIowever, since this arrangement is for a digital input at the amplifiers 22, the threshold arrangement set forth with regard to figure 3 is not so easily provided. In other respects the operation of the circuit is the same as that of figure 3 and the occurance of an output 25 of AND gate 24 would correspond to the output 20 of gate 18 previously discussed.

12096~9 J.J. Stapleton-1 The device in~ends to allow the utilization of a conventional CXT and the regulating of the control grids as aforementioned of the CRT to allow effective pixel reproduction based upon sychronized signals. However, unlike conventional CRTs, it has unity gamma and color stability derived from use of the CRT as a feedback element of transconductance amplifiers. In this reyard, figure 6 is a somewhat simplified depiction of a CRT 26 contained as a feedback elemen~ of a transconductance operational amplifier 28. The transconductance amplifier 28 would be one of three for each of the color circuits for RGB.

In basic operation, a signal voltage corresponding to that for the particular color applied at the non-inverting input 30 o~ ~he amplifier 28 will be the same as the voltage at the cathode 32.
~he beam current at the cathode is varied by varying voltage of the grid 34 which is responsive to voltage variation at input 30. The voltage at the grid would also be responsive to pulse sychronizing provided, for example by the logic arrangements in figures 4 and 5, thereby regulating the beam current.

Therefore, by varying the voltage input at 30, beam

3 currents are produced which are proportional to the signal voltage as a result of driving of the CRT grid 34 of the cathode 32 within the feedback loop. Gamma ln such an arrangement is approximately unity whereas the conventional color CRTs gamma i5 about 2.5. Thus the CRT can be linearly modulated and responds to display linear ; levels responsive to linear input si~nal voltage at input 30.

This linear operation provides a system that follows the input and allows for repeatability of the signal without dilution of possible targets. The output remains the same from time to time or from tube to tube without variation.

3 Turning now to figure 7, there is shown a detailed schematic representation of the feedback circuit of figure 6 which clrives the CRT as a feedback element of the transconductance operational amplifier.
As aorementioned, this would be one of three amplifiers, one for l1 ~2~
J.J. Stapleton-l each of the primaries, - Blue, - Green, and - Red with - Red being representatively depicted. The same arrangement would be utilized for - Greén and - Blue, which are shown connected with the CRT by the representative PNP cascode transistors 36 and 38 respectively, with minor modifications which will be explained. Parts corresponding to figure 6, will be si~;lariy numbered with however a prime~

The input circuitry to the amplifier 28' consists of a four bit digital to analog convertor 40 having inputs 42, 44, 46 and 50. These correspond to the Gold bits) 2-23 respectively and O are connected to the summing point 52 via the scaling resistor 54 Also connected to point 52 is a bias voltage ~hrough a current }imiting resistor 56.

At the inverting input 58 of the operational amplifier 28', the signals or pulses correspondiny to ~ ~ and ~ ~ are applied via the inputs 60 and 62 and scaling resistors 64 and 66 respectively.
The reason for this is that since the signal or pulse for - Red or ~ 5 is the re~a nder of subtracting J~ ~ ana ~I from the composite Gold, this o~eratjon is provided for by this circuitry.
In the case of - Green and - Blue, this input would be unnecessary 0 since the pulse or signal to control their guns is already known and would be applied to corresponding terminals 2-23 for the - Green bits and - Blue bits respectively. In all other respects, however, the circuitry as illustrated for the - Red would be the same for -Green and - Blue.

~5 Unblanking is provided by connecting the output of the logic arrangements shown in figures 4 and 5 to the input 58 via the input terminal 68. This allows for the voltage which is applied at the grid 34' to be pulse modulated via the logic arrange-ment utilized so as to provide production of each pixel when the ,~ signals for each wavelength is sychronized.

J.J. Stapleton-l The output of the operational amplifier 28' drives the base of transistor 70 which is cascode with transistor 72. In operation, a high voltage is applied to the grid via input 76, and as current to the base of transistor 70 increases, more current `b passes through the collector and emitter of transistor 70 and 72 causing a voltage drop across resistor 74 and thus decreasing the voltage at the grid. Biasing of resistor 72 is provided by resistor 78 which is interposed between the input 76 and the base of said transistor.

The feedback loop to the non-inverting input 30' of the operational amplifier 28' is provided by the transistors 70 and 72 whose collector connects to the input 76 and the cathode 32' via resistor 79. The loop is completed by connecting the ca~hode 32' to the emitter of transistor 80 which is cascode with transistor 82 which in turn connects to input 30'. This PNP
cascode arrangement as shown, provides for a constant current source to the cathode 32' during operation.

In addition, the output of the amplifier 28' has a feedback connector to its invertiny input via resistor 70, diode 84 ~0 and resistor 86.

In operation, an input video voltage is applied at inputs 42 through 50 which corresponds to the Gold bits 2-23 respectively as aforementioned. This input video voltage may be the digital codiication of the particular wavelengths as aforementioned. This 5 applies at the input 30' of the operational amplifier 28', a voltage which increases and decreases for each coded pixel accordingly.
A high voltage is applied to the grid 34' via input 76, and if during image display the input voltage decreases at inputs 42 to 50, this causes an increase in voltage at input 30' which in turn results in ~0/ a decrease in the grid 34' voltage. This decrease in the grid voltage ~209~i~
J.J. Stapleton-l (going negative) pulling it down, causes a decrease in the beam current produced by the cathode. An increase in the grid voltage would provide for the opposite occurance and thereby provide for a linear beam current responsive to a video voltage input. Of course, the operational amplifier 2~' should have enough gained so that the voltage at the input 30' results in the modulation of the grid 34' as aforementioned.

Also, as previously mentioned, the circuitry and arrange-ments for - Green and - Blue would operate in a similar fashion,with Q the noted modifications,through the unblanking of the signals at a specific time by applying the signal output from the logic arranye-m~nt to each amplifier. This allows for effective pixel by pixel mappillg and provides for a displa~ of the color coded image on a CRT responsive to the particular pseudo color assigned to the trichroic IR wavelengths.

In addition, it might be noted that the input signal to the Gold comparitors 14 in figure 4 may be taken from the sum~ing point (for - Blue and - Green from their correspondin~ summin~ point).
If a digital system is used as shown in figure 5, then the input 0 signals placed at inputs 2-23 for Gold could be placed upon the amplifiers 22 for Gold, (for - Blue and - Green from the corresponding 2-23 bits to the amplifiers 22 for - Blue and - Green respectively).
While a somewhat detailed description of the preferred embodiment has been disclosed and described herein, its scope should 5~ not be limited thereby rather its scope should be determined ~y that of the appended claims.

Claims (13)

THE EMBODIMENTS OF THE INVENTION IN WHICH AN EXCLUSIVE
PROPERTY OR PRIVILEGE IS CLAIMED ARE DEFINED AS FOLLOWS:

1. A device for displaying multi-sensor or multi-spectral data which is in the form of video signals corresponding to said data, as an image, said device comprising:
at least one gun capable of providing a beam current;
an operational amplifier for said gun having an input, capable of receiving a video signal, and an output;
a feedback loop connected between the output and input of said operational amplifier incorporating in said loop said gun and driving said gun as a feedback element a result of which is the production of a beam current by the gun which varies linearly as the video signal to the amplifier varies during image production.

2. A device for displaying in visible color multi-sensor or multi-spectral data which is in the form of video signals corresponding to said data, said device comprising:
a plurality of color guns each of which is capable of providing a separate beam current, with at least one gun for each primary color to be displayed;
a plurality of operational amplifiers each having an input, capable of receiving a video signal corresponding to a primary color with at least one amplifier for each color gun, and an output;
a feedback loop connected between the output and the input of each operational amplifier respectively, incorporating in said loop a single color gun which is driven as a feedback element of said amplifier a result of which is the production of a beam current by the gun which varies linearly as the video signal to the amplifier varies during image production.

3. A device for displaying in visible color infrared signals produced by an infrared scanning system with said signals in the form of video color signals assigned to said infrared signal, said device including:
a plurality of color guns each of which is capable of producing a beam current, with at least one gun for each primary color to be displayed;
a plurality of operational amplifiers with at least one amplifier for each color gun, each amplifier having an input capable of receiving a video signal which corresponds to said infrared signal, and an output;
a feedback loop connected between the output and the input of each operational amplifier respectively, incorporating in said loop a single color gun which is driven as a feedback element of said amplifier, a result of which is the production of a beam current by each gun which varies linearly as the video signal to the amplifier varies during image production.

4. The device in accordance with any of claims 1-3 which includes a CRT and at least 3 color guns with one gun for each of the primary colors RGB to be displayed, with the beam currents from each of these guns simultaneously capable of creating a picture element on the CRT.

5. The device in accordance with any of claims 1-3 wherein the video signal is digital data word and the input to each of the amplifiers includes a digital to analog convertor.

6. The device in accordance with any of claims 1-3, wherein the input of the amplifier connects to a first terminal input of each of the respective amplifiers.

7. The device in accordance with claim 1 which further includes a means capable of blanking the beam current at predetermined intervals.

8. The device in accordance with claim 7 wherein said intervals are when the video signals to each of the amplifiers are not sychronized for picture element production.

9. The device in accordance with claim 7 wherein said means includes a logic arrangement capable of accepting digital signals to control the blanking of the beam currents.

10. The device in accordance with claim 7 wherein said means includes a logic arrangement capable of accepting analog signals to control the blanking of the beam currents.

11. The device in accordance with claims 9 or 10 wherein the outputs of said logic arrangement is connected to a second terminal input of each respective amplifier.

12. The device in accordance with claim 3 wherein the infrared signals are produced by a trichroic scanning system and for each picture element include a composite signal and at least two other signals corresponding to different infrared bands.

13. The device in accordance with claim 12 which includes a means capable of regulating the operation of a gun based upon a signal which is a function of the composite and the two other signals.