EP0215008A1 - Programmable methods of performing complex optical computations using data processing system. - Google Patents

Programmable methods of performing complex optical computations using data processing system.

Info

Publication number
EP0215008A1
EP0215008A1 EP86900432A EP86900432A EP0215008A1 EP 0215008 A1 EP0215008 A1 EP 0215008A1 EP 86900432 A EP86900432 A EP 86900432A EP 86900432 A EP86900432 A EP 86900432A EP 0215008 A1 EP0215008 A1 EP 0215008A1
Authority
EP
European Patent Office
Prior art keywords
data
dimensional
spatial light
matrix
modulators
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP86900432A
Other languages
German (de)
French (fr)
Other versions
EP0215008B1 (en
Inventor
Jan Grinberg
Graham R Copgrove West En Nudd
Bernard H Soffer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Raytheon Co
Original Assignee
Hughes Aircraft Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hughes Aircraft Co filed Critical Hughes Aircraft Co
Publication of EP0215008A1 publication Critical patent/EP0215008A1/en
Application granted granted Critical
Publication of EP0215008B1 publication Critical patent/EP0215008B1/en
Expired legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06EOPTICAL COMPUTING DEVICES; COMPUTING DEVICES USING OTHER RADIATIONS WITH SIMILAR PROPERTIES
    • G06E3/00Devices not provided for in group G06E1/00, e.g. for processing analogue or hybrid data
    • G06E3/001Analogue devices in which mathematical operations are carried out with the aid of optical or electro-optical elements
    • G06E3/005Analogue devices in which mathematical operations are carried out with the aid of optical or electro-optical elements using electro-optical or opto-electronic means

Definitions

  • the present invention generally relates to methods of operating optical computing and data processing systems and, in particular, to methods of operating a multistage lensless optical processor that is electrically programmable to perform a wide variety of complex computations on optical data.
  • Images, or other spatially relatable data may be treated as matrices composed of rastor or vector scans of data elements that, at their real or effective resolution limit, are generally referred to as pixels.
  • An ordinary image is typified by an analog picture frame taken as a cross section of an optical beam formed of a continuous series of such images. Each analog image frame typically contains an effectively continuous spatially distributed array of pixel data.
  • discrete matrix data may be impressed onto a data beam by spat ially modulating the cross section of a data beam in terms of, for example, either its localized intensity or polarization vector.
  • optical processing is of great potential value due to its fundamentally parallel processing nature.
  • the parallelism arises due to the processing of complete images at a time.
  • the volume of data processed in parallel is generally equivalent to the effective resolution of the image.
  • optical processing has the virtue of processing data in the same format that it is conventionally obtained.
  • the data to be processed is generally obtained as a single image or as a rastor scan of an image frame.
  • an optical processor may receive data directly without conventional or other intermediate processing. Since the informative value of image data increases with the effective resolution of the image and the number of images considered, the particular and unique attributes of optical processing become quite desirable.
  • optical processing is performed by projecting an image to be processed through a selected spatial mask onto an appropriate optical detector.
  • the mask itself is, in its simplest form, only an image fixed in a film. Even as such, relatively complex optical processing computations may be performed.
  • Optical processor projection systems generally require a variety of highly specialized components including arc lamps as illuminating point sources, collimating and focusing lenses, polarizing . and polarization rotation plates, beam splitters, and mirrors.
  • arc lamps as illuminating point sources, collimating and focusing lenses, polarizing . and polarization rotation plates, beam splitters, and mirrors.
  • these components must be assembled and maintained, often in critical alignment, spatially separated from one another. Consequently, the optical processing apparatus is large and bulky, sensitive to its environment, particularly in terms of vibration and contamination, and specifically limited to performing one or only a few quite closely related optical processing calculations.
  • a temporally variable mask for optical processors has been realized as a two-dimensional spatial light modulator (SLM) that, through electronic activation, effects selective alteration of the spatially distributed data impressed on a data beam by the mask.
  • SLM spatial light modulator
  • a typical two-dimensional (2D) SLM is realized through the use of a photoelectrically activated reflective type liquid crystal light valve which may be coupled to a cathode ray tube.
  • 2D SLM devices perform well for many applications within specific limits. Unfortunately, these performance limits include a relatively slow liquid crystal light valve response time of typically greater than 10 milliseconds. This naturally directly impacts the high speed processing capability of an optical processor.
  • Two-dimensional SLM masks have also been realized in the form of a solid electro-optical element activated by a two-dimensional spatially distributed array of electrodes.
  • the modulating image is effectively formed by separately establishing the voltage potential of each of the electrodes at an analog corresponding to their respective intended data values.
  • the complexity level of such a two-dimensional SLM increases proportionally to the square of its pixel resolution (N).
  • the current level of fabrication technology unfortunately, stands as a practical barrier to the reproducible fabrication of even moderately high resolution independent pixel addressable two-dimensional SLM devices. Alternately using a low effective resolution mask would directly impact the high speed data processing capabilities of the optical processor.
  • a purpose for the present invention is, therefore, to provide methods of continuously, iteratively operating an optical data processor to perform a wide variety of complex data processing functions while avoiding or overcoming most, if not all, of the processing limitations incurred in the prior art.
  • the methods of the present invention are preferably performed using an apparatus comprising a plurality of modulators for spatially modulating the optical data beam, means for the lensless interconnection of each of the modulators to provide for the focusless transfer of the optical data beam between the modulators, and means for controlling the plurality of modulators so as to permit the programmable processing of the optical data beam.
  • an advantage of the present invention is that it can be utilized to perform a wide variety of optical data processing computations.
  • Another advantage of the present invention is that it permits the continuously iterative processing of temporally changing optical data.
  • a further advantage of the present invention is that it effectively provides for the dynamic modification and reconfiguration of the processing apparatus by data programming.
  • Still another advantage of the present invention is that it is readily adaptable to the performance of any desired optical computation.
  • Yet another advantage of the present invention is that it can conveniently implement such computationally intensive optical data processing functions as multid imensional Fourier transform , cross correlation , and sliding window cross-ambiguity functions for example.
  • FIG. 1 is a perspective block diagram of a preferred optical data processing system in accordance with the present invention
  • FIG. 2 is a side view of a preferred generic embodiment of an optical data processor constructed for use in accordance with the present invention
  • FIG. 3 is a perspective detail of an electro-optical spatial light modulator.
  • FIG. 4 is a perspective view of another electro-optical spatial light modulator.
  • FIG. 5 is an exploded perspective representation of a preferred embodiment of an optical processor for illustrating the preferred methods of operation in accordance with the present invention.
  • the preferred system embodiment for use with the present invention is shown in FIG. 1.
  • the preferred multistage optical data processor (ODP) is operatively supported by the microcontroller 12 and interface registers 18, 22, 24, 26, 30, 32 and 34. While the preferred structure of the ODP 20 will be described in greater detail below, the principle operative components of the ODP 20 are shown in FIG. 1 as including a flat panel light source 14, matrix array accumulator 16 and a plurality of spatial light modulators (SLMs) 36, 38, 40, 42, 44 and 46.
  • SLMs spatial light modulators
  • the light source 14, accumulator 16 and the SLMs 36, 38, 40, 42, 44, 46 are provided in closely adjacent parallel planes with respect to one another such that a relatively uniform beam sourced by the light source 14 travels through each of the spatial light modulators in succession and is ultimately received by the accumulator 16.
  • the light beam is effectively used as a data transport mechanism acquiring data provided by each of the spatial light modulators that is subsequently delivered to the accumulator 16.
  • the operation of each of the spatial light modulators can be explained in terms of their spatial transmissivity variation with respect to corresponding spatially distributed activating voltage potentials.
  • the transmissivity of a spatial light modulator is directly proportional to the applied voltage potential.
  • the combined transmissivity (T 0 ) of two serially coupled spatial light modulators is proportional to the product of the respective transmissivities of the spatial light modulators.
  • the combined transmissivity T 0 can thus be written as:
  • V 1 and V 2 are the respectively applied voltage potentials
  • ⁇ and ⁇ are the transmissivity to applied voltage coefficients for the respective spatial light modulators.
  • the combined transmissivity To of the multistage spatial light modulator stack is proportional to the product of the respective transmissivities of the individual spatial light modulators.
  • a light beam sourced by the flat panel 14 can thus be directed to acquire spatially distributed data corresponding to the spatially distributed relative transmissivities of each of the spatial light modulators 36, 38, 40, 42, 44 and 46.
  • spatially relatable data is provided to the spatial light modulators 36, 38, 40, 42, 44 and 46 via the interface registers 22, 24, 26 , 30, 32 and 34.
  • These registers preferably operate as high speed digital data storage registers, buffers and digital-to-analog data converters.
  • the stack of spatial light modulators preferably includes a plurality of one-dimensional spatial light modulators and one or more two-dimensional spatial light modulators. As shown in FIG. 1, onedimensional spatial light modulators 36, 38, 40, 42 and 44 are coupled to respective registers 22, 30, 24, 32 and 26 via interface data lines 60, 78, 62, 80 and 64.
  • a two-dimensional spatial light modulator 46 receives data from register 34 via the interface data line 82.
  • the interface registers 22, 24, 26, 30, 32 and 34 in turn preferably receive data in a parallel form provided by external sensors.
  • the microcontroller 12 via the processor control buses 50, 70 provides the control signals. While the processor control buses 50, 70 are shown as separate and respectively connected to the registers by the register control lines 52, 54, 56, 72, 74 and 76, the interface registers may alternately be coupled via control multiplexers to a single, common control bus driven by the microcontroller 12. In either case, however, it is essential only that the microcontroller 12 possess sufficient control over the registers 22, 24, 26, 30, 32 and 34 to selectively provide its predetermined data thereto.
  • the optical data processor system 10 is completed with the provision of the output register 18 coupled between the accumulator 16 and the processor output.
  • the accumulator 16 itself is a matrix array photosensitive device capable of converting incident light intensity into a corresponding voltage potential representative of the data beam at an array resolution at least matching that of the spatial light modulators 36, 38, 40, 42, 44 and 46.
  • the accumulator 16 accumulates light beam data that can then be shifted by means of a clock signal supplied by a clock generator 83 to the data output register 18 via the output interface bus 88.
  • the accumulator 16 also includes circular shift bus 86 and lateral shift bus 84 to permit a wide variety of shift and sum operations to be performed within the accumulator 16 during the operation of the optical data processor 20.
  • the data output register 18 is preferably a high speed analog-to-digital converter, shift register and buffer that channels the shifted output data from the accumulator 16 to the processor output via the processor data output bus 90.
  • the microcontroller 12 possesses full control over the optical data processor 20.
  • Any desired data can be provided to any specific combination of spatial light modulators to implement a desired data processing algorithm.
  • Spatial light modulators within the optical data processor 20 may be provided with appropriate data via their respective data registers to uniformly maintain the spatial light modulators at their maximum transmissivity. Consequently, selected spatial light modulators may be effectively removed from the optical data processor by their appropriate data programming.
  • the optical data processing system 10 provides an extremely flexible environment for the performance of optical data processing computations.
  • the structure of an exemplary optical data processor 20 fabricated in accordance with the preferred optical processor embodiment of the present invention is shown in FIG. 2.
  • the embodiment shown is exemplary as including substantially all of the principle components that may be incorporated into any preferred embodiment of the optical processor.
  • the components of the optical data processor may be functionally grouped as parts of a light source 91, SLM stage 92 and data beam receiver 93.
  • the light source 91 essentially includes the flat panel light source 14 and, optionally, a light beam buffer component 94.
  • the flat panel light source 14 is preferably an electroluminescent display panel or, alternately, a gas plasma display panel or LED or LED array or laser diode or laser diode array.
  • the buffer component 94 is preferably utilized to grade the light produced by the flat panel display panel into a spatially uniform optical beam. Where a gas plasma display is utilized, the buffer component 94 may further function to insulate the remainder of the optical data processor 20 from any heat generated by the plasma display 14. In either case, the buffer component 94 is preferably an optical glass plate having a thickness of approximately 0.25 inch.
  • the bulk of the optical data processor 10 is formed by a serial stack of SLM stages, of which SLM stage 92 is representative. While each stage is preferably identical in terms of their component composition, the SLM of each is the only essential component. Preferably, the SLM is a rigid structure requiring no additional support. In such embodiments, the SLMs may be placed immediately adjacent one another, separated only by a thin insulating optically transparent layer, yielding an optimally compact multistage stack of spatial light modulators. However, where the spatial. light modulators are, for example, of a material possessing insufficient structural strength to provide for their own support, the stage 92 preferably further includes a supporting fiber optic plate 102.
  • the fibers of the fiber optic plate 102 are, of course, aligned with their cylindrical axes parallel the major axis of the optical data processor 20.
  • a polarizer 64 is preferably interposed between the SLM 44 and fiber optic plate 102.
  • the polarizer 64 further permits the utilization of an unpolarized optical data beam source 14 in local polarization vector data representation embodiments of the present invention. If the principle of operation of the spatial light modulation is light absorption (instead of polarization rotation), then there is no need for the polarizers.
  • the data beam receiver 93 essentially includes an accumulator component 16.
  • the accumulator 16 is preferably a solid state matrix array of optical detectors.
  • the optical detector array is preferably a two-dimensional shift register array of conventional charge coupled devices (CCDs) provided at an array density equivalent to the effective resolution of the optical data processor 20.
  • CCDs charge coupled devices
  • the use of a CCD array is preferred both for its charge accumulation, i.e., data summing, capability as well as for the ease of fabricating CCD shift register circuitry that can be directly controlled by the microcontroller 12. Further, the use of the CCD array permits substantial flexibility in the operation of the accumulator 16 by permitting data shifted out of the accumulator 16 and onto the data return bus 88 to be cycled back into the accumulator 16 via the circular shift data bus 86.
  • the accumulator 16 possesses the desirable flexibility through the use of adjacent register propagation path interconnections to permit lateral cycling of the data contained therein via the lateral shift data bus 84 generally as indicated in FIG. 1. Consequently, the accumulator 16 can be effectively utilized in the execution of quite complex optical data processing algorithms involving shift and sum operations under the direct control of the microcontroller 12.
  • the data beam receiver 93 may optionally include a fiber optic plate 122 as may be desirable in interconnecting the accumulator 16 with the SLM 44 of the last stage 92 of the optical data processor 20.
  • the preferred embodiments of the two one-dimensional spatial light modulators are shown in FIGS. 3 and 4.
  • the spatial light modulator 130 shown in FIG. 3 includes an electro-optic element 132 preferably having two major parallel opposing surfaces upon which stripe electrodes 136 and potential reference plane 140 are provided respectively.
  • the electro-optic element 132 may be a transmission mode liquid crystal light valve though preferably it is a solid state electro-optic material, such as KD 2 PO 4 or BaTiO 3 . This latter material polarization modulates light locally in proportion to the longitudinal and transverse voltage potential applied across that portion of the material that the light passes through.
  • Electrodes 136, 140 are preferably of a highly conductive transparent material such as indium tin oxide. Contact to the electrodes 136, 140 is preferably accomplished through the use of separate electrode leads 134, 138, respectively, that are attached using conventional wire bonding or solder bump interconnect technology.
  • a variation of the spatial light modulator 130 provides a zero dimensional, or uniform, spatial light modulator that is of particular utility in the present invention.
  • the transmissivity of the electro-optic material 132 will be uniformly modulated at all pixel locations.
  • a single electrode covering the entire major surface of the electro-optic material 132 may be substituted for the stripe electrodes 136.
  • FIG. 4 illustrates an alternate one-dimensional spatial light modulator. This spatial light modulator significantly differs from that of FIG. 3 by the relative placement of the signal 156 and potential reference 158 electrodes on the two major surfaces of the electro-optic element 152.
  • a reference potential electrode 158 is interposed between pairs of the signal electrodes 156 to form an interdigitated electrode structure that is essentially identical on both major surfaces of the electro-optic element 152.
  • the active portions of the electro-optic element 152 lie between each of the signal electrodes 156 and their surface neighboring reference potential electrodes 158.
  • the achievable electro-optic effect is enhanced through the utilization of both surfaces of the electro-optic element 152.
  • all of the electrodes 156, 168 may be of an opaque conductive material, such as aluminum, that may be further advantageously utilized to effectively mask the active regions of the electro-optic element 152. That is, the electrodes 156, 158 may be utilized to block the respective pixel edge portions of the data beam as they diverge while passing through the electro-optic element 152.
  • the electro-optic element 152 may be either a liquid crystal light valve or a solid state electro-optic material.
  • transverse field polarization modulation electro-optic materials such as represented by LiNbO 3 , LiTaO 3 , BaTiO 3 , Sr x Ba (1-x) NbO 3 and PLZT are preferred. These materials are believed to possess the generally equivalent structural strength characteristics as the polarization modulation material KD 2 PO 4 described above.
  • Electrode leads to the electrode strips 156, 158 are again preferably attached using conventional wire bonding or solder bump interconnect technology.
  • optical data processor 20 is functionally illustrated as a series of planes A, B, C, D, E and F, each plane parallel to the X and Y axis and distributed along the Z axis of the coordinate system 200.
  • the optical data processor 20 is shown as having an effective resolution of three by three pixels.
  • planes A, B and C contain registers 212, 214, 218 interconnected by buses 234, 236, 238 to one-dimensional spatial light modulators 202, 204, 206 and to the microcontroller 12 by buses 222, 224, 226, respectively.
  • the registers 212, 214, 216 each preferably includes a three by three pixel buffer array.
  • the A and B plane one-dimensional spatial light modulators 202, 204 provide for the modulation of three pixel rows (parallel to the X axis).
  • the spatial light modulator 206 of plane C is distinguished as providing for the modulation of three pixel columns (parallel to the Y axis).
  • a two-dimensional spatial light modulator 208 driven by register 218 via bus 240 is provided in plane D with both being interconnected with the microcontroller 12 by the bus 230. Since, as will be demonstrated below, the operation of the two-dimensional spatial light modulator is effectively static with respect to the other planes of the optical data processor, the necessity of high speed independent addressing of the array electrodes is substantially obviated. Rather, simpler shift register mode propagation of data may be utilized in the operation of the two-dimensional spatial light modulator 208. Consequently, the construction constraints and complexity limitations in the reliable fabrication of high resolution matrix spatial light modulators are greatly eased for purposes of the present invention.
  • Plane E includes the three by three pixel register 220 that is interconnected with a uniform, zero-dimensional spatial light modulator 210 via the single pixel bus 242 and both with the microcontroller 12 via the bus 232.
  • a matrix array accumulator 14 is provided in plane F.
  • circular 86 and lateral 84 shift buses are provided to permit flexible sum and shifting operations to be performed under the control of the microcontroller 12.
  • a two-dimensional Fourier transform of two-dimensional data is performed by: Initialize
  • a two-dimensional cross correlation of two-dimensional data, appropriate for image recognition, is performed by:
  • a one-dimensional sliding window cross ambiguityfunction calculation with respect to one-dimensional data is performed by: Initialize

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Nonlinear Science (AREA)
  • Optics & Photonics (AREA)
  • General Physics & Mathematics (AREA)
  • Optical Modulation, Optical Deflection, Nonlinear Optics, Optical Demodulation, Optical Logic Elements (AREA)
  • Liquid Crystal (AREA)

Abstract

Procédés d'exécution de calculs optiques complexes, en utilisant de préférence un processeur programmable de données optiques. Les calculs optiques sont exécutés en utilisant une pluralité de modulateurs de lumière dans l'espace, pour moduler un faisceau en fonction des données, le procédé d'exécution des calculs consistant a) à appliquer les données à un sous-ensemble de modulateurs de manière à moduler le faisceau avec une image de données correspondante; b) à appliquer des données uniformes aux modulateurs restants de manière à moduler le faisceau avec des images de données uniformes correspondantes, de sorte que le calcul exécuté dépend des données appliquées au sous-ensemble de modulateurs.Methods of performing complex optical calculations, preferably using a programmable optical data processor. The optical calculations are performed using a plurality of spatial light modulators to modulate a beam as a function of the data, the method of performing the calculations comprising a) applying the data to a subset of modulators in such a way modulating the beam with a corresponding data image; b) applying uniform data to the remaining modulators so as to modulate the beam with corresponding uniform data images, so that the calculation performed depends on the data applied to the subset of modulators.

Description

PROGRAMMABLE METHODS OF PERFORMING COMPLEX OPTICAL COMPUTATIONS USING DATA PROCESSING SYSTEM
FIELD OF THE INVENTION
The present invention generally relates to methods of operating optical computing and data processing systems and, in particular, to methods of operating a multistage lensless optical processor that is electrically programmable to perform a wide variety of complex computations on optical data.
BACKGROUND OF THE INVENTION Optical processing of vector and matrix data is known for its potential high effective computational performance capabilities and its natural adaptability to computationally intensive image processing. Images, or other spatially relatable data, may be treated as matrices composed of rastor or vector scans of data elements that, at their real or effective resolution limit, are generally referred to as pixels. An ordinary image is typified by an analog picture frame taken as a cross section of an optical beam formed of a continuous series of such images. Each analog image frame typically contains an effectively continuous spatially distributed array of pixel data. Alternately, discrete matrix data may be impressed onto a data beam by spat ially modulating the cross section of a data beam in terms of, for example, either its localized intensity or polarization vector. In any case, optical processing is of great potential value due to its fundamentally parallel processing nature. The parallelism, of course, arises due to the processing of complete images at a time. As each pixel is a separate datum, the volume of data processed in parallel is generally equivalent to the effective resolution of the image. Additionally, optical processing has the virtue of processing data in the same format that it is conventionally obtained. Typically, and for such applications as image enhancement and recognition, the data to be processed is generally obtained as a single image or as a rastor scan of an image frame. Potentially then, an optical processor may receive data directly without conventional or other intermediate processing. Since the informative value of image data increases with the effective resolution of the image and the number of images considered, the particular and unique attributes of optical processing become quite desirable. Conventionally, optical processing is performed by projecting an image to be processed through a selected spatial mask onto an appropriate optical detector. The mask itself is, in its simplest form, only an image fixed in a film. Even as such, relatively complex optical processing computations may be performed.
Optical processor projection systems, however, generally require a variety of highly specialized components including arc lamps as illuminating point sources, collimating and focusing lenses, polarizing . and polarization rotation plates, beam splitters, and mirrors. In addition to their respective fabrication complexities, these components must be assembled and maintained, often in critical alignment, spatially separated from one another. Consequently, the optical processing apparatus is large and bulky, sensitive to its environment, particularly in terms of vibration and contamination, and specifically limited to performing one or only a few quite closely related optical processing calculations. In addition to photographic films, a temporally variable mask for optical processors has been realized as a two-dimensional spatial light modulator (SLM) that, through electronic activation, effects selective alteration of the spatially distributed data impressed on a data beam by the mask. A typical two-dimensional (2D) SLM is realized through the use of a photoelectrically activated reflective type liquid crystal light valve which may be coupled to a cathode ray tube. Aside from the inefficiency of the dual serial electric-to-optical conversion of the image, such 2D SLM devices perform well for many applications within specific limits. Unfortunately, these performance limits include a relatively slow liquid crystal light valve response time of typically greater than 10 milliseconds. This naturally directly impacts the high speed processing capability of an optical processor. Additionally, the use of this type of mask requires further focusing, beam splitting and support components with the end result being a mechanically complex optical processor. Two-dimensional SLM masks have also been realized in the form of a solid electro-optical element activated by a two-dimensional spatially distributed array of electrodes. The modulating image is effectively formed by separately establishing the voltage potential of each of the electrodes at an analog corresponding to their respective intended data values. As may be well expected, the complexity level of such a two-dimensional SLM increases proportionally to the square of its pixel resolution (N). Complexity further increases where the N2 electrodes must be independently addressable to permit operation at data rates sufficiently high to be of utility in optical data processing (for instance, for N = 1000, one has to address 1 million electrodes). The current level of fabrication technology, unfortunately, stands as a practical barrier to the reproducible fabrication of even moderately high resolution independent pixel addressable two-dimensional SLM devices. Alternately using a low effective resolution mask would directly impact the high speed data processing capabilities of the optical processor.
In view of the foregoing limitations of conventional optical data processing apparatus, the methods of performing optical computations have been correspondingly constrained. Intermediate results of a computation must be stored or otherwise fixed in a medium while the processing apparatus is modified or adjusted to perform most any significantly different computational stop or utilize a different spatial mask in the computation.
SUMMARY OF THE INVENTION
A purpose for the present invention is, therefore, to provide methods of continuously, iteratively operating an optical data processor to perform a wide variety of complex data processing functions while avoiding or overcoming most, if not all, of the processing limitations incurred in the prior art.
This is attained in the present invention by providing for the performance of optical computations using a plurality of spatial light modulators to impress data onto a data beam, the methods of performing the computations comprising the steps of: (a) applying respective data to a subset of the modulators so as to impress corresponding data images onto the beam; and (b) applying uniform data to the remaining ones of the modulators so as to impress corresponding uniform data onto the beam such that the computation performed is dependent on the data applied to the subset of the modulators.
The methods of the present invention are preferably performed using an apparatus comprising a plurality of modulators for spatially modulating the optical data beam, means for the lensless interconnection of each of the modulators to provide for the focusless transfer of the optical data beam between the modulators, and means for controlling the plurality of modulators so as to permit the programmable processing of the optical data beam.
Thus, an advantage of the present invention is that it can be utilized to perform a wide variety of optical data processing computations.
Another advantage of the present invention is that it permits the continuously iterative processing of temporally changing optical data. A further advantage of the present invention is that it effectively provides for the dynamic modification and reconfiguration of the processing apparatus by data programming.
Still another advantage of the present invention is that it is readily adaptable to the performance of any desired optical computation.
Yet another advantage of the present invention is that it can conveniently implement such computationally intensive optical data processing functions as multid imensional Fourier transform , cross correlation , and sliding window cross-ambiguity functions for example. BRIEF DESCRIPTION OF THE DRAWINGS
Other attendant advantages of the present invention will become apparant and readily appreciated as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings in which like reference numerals designate like parts throughout the figures, and wherein:
FIG. 1 is a perspective block diagram of a preferred optical data processing system in accordance with the present invention;
FIG. 2 is a side view of a preferred generic embodiment of an optical data processor constructed for use in accordance with the present invention; FIG. 3 is a perspective detail of an electro-optical spatial light modulator.
FIG. 4 is a perspective view of another electro-optical spatial light modulator; and
FIG. 5 is an exploded perspective representation of a preferred embodiment of an optical processor for illustrating the preferred methods of operation in accordance with the present invention.
DETAILED DESCRIPTION OF THE INVENTION The preferred system embodiment for use with the present invention, generally indicated by the reference numeral 10, is shown in FIG. 1. In particular, the preferred multistage optical data processor (ODP), generally indicated by the reference numeral 20, is operatively supported by the microcontroller 12 and interface registers 18, 22, 24, 26, 30, 32 and 34. While the preferred structure of the ODP 20 will be described in greater detail below, the principle operative components of the ODP 20 are shown in FIG. 1 as including a flat panel light source 14, matrix array accumulator 16 and a plurality of spatial light modulators (SLMs) 36, 38, 40, 42, 44 and 46. Preferably, the light source 14, accumulator 16 and the SLMs 36, 38, 40, 42, 44, 46 are provided in closely adjacent parallel planes with respect to one another such that a relatively uniform beam sourced by the light source 14 travels through each of the spatial light modulators in succession and is ultimately received by the accumulator 16. The light beam is effectively used as a data transport mechanism acquiring data provided by each of the spatial light modulators that is subsequently delivered to the accumulator 16. The operation of each of the spatial light modulators can be explained in terms of their spatial transmissivity variation with respect to corresponding spatially distributed activating voltage potentials. To a first approximation at least, the transmissivity of a spatial light modulator is directly proportional to the applied voltage potential. Thus, the combined transmissivity (T0) of two serially coupled spatial light modulators is proportional to the product of the respective transmissivities of the spatial light modulators. The combined transmissivity T0 can thus be written as:
T0 = T1 x T2 (1)
T0 = α β V1 V2 (2)
where V1 and V2 are the respectively applied voltage potentials, and α and β are the transmissivity to applied voltage coefficients for the respective spatial light modulators. Where an extended series of spatial light modulators are serially coupled, in accordance with the present invention, the combined transmissivity To of the multistage spatial light modulator stack is proportional to the product of the respective transmissivities of the individual spatial light modulators. A light beam sourced by the flat panel 14 can thus be directed to acquire spatially distributed data corresponding to the spatially distributed relative transmissivities of each of the spatial light modulators 36, 38, 40, 42, 44 and 46.
In accordance with the preferred embodiment of the optical processor used in accordance with the present invention, spatially relatable data is provided to the spatial light modulators 36, 38, 40, 42, 44 and 46 via the interface registers 22, 24, 26 , 30, 32 and 34. These registers preferably operate as high speed digital data storage registers, buffers and digital-to-analog data converters. As will be discussed in greater detail below, the stack of spatial light modulators preferably includes a plurality of one-dimensional spatial light modulators and one or more two-dimensional spatial light modulators. As shown in FIG. 1, onedimensional spatial light modulators 36, 38, 40, 42 and 44 are coupled to respective registers 22, 30, 24, 32 and 26 via interface data lines 60, 78, 62, 80 and 64. A two-dimensional spatial light modulator 46 receives data from register 34 via the interface data line 82.
The interface registers 22, 24, 26, 30, 32 and 34 in turn preferably receive data in a parallel form provided by external sensors. The microcontroller 12 via the processor control buses 50, 70 provides the control signals. While the processor control buses 50, 70 are shown as separate and respectively connected to the registers by the register control lines 52, 54, 56, 72, 74 and 76, the interface registers may alternately be coupled via control multiplexers to a single, common control bus driven by the microcontroller 12. In either case, however, it is essential only that the microcontroller 12 possess sufficient control over the registers 22, 24, 26, 30, 32 and 34 to selectively provide its predetermined data thereto.
The optical data processor system 10 is completed with the provision of the output register 18 coupled between the accumulator 16 and the processor output. The accumulator 16 itself is a matrix array photosensitive device capable of converting incident light intensity into a corresponding voltage potential representative of the data beam at an array resolution at least matching that of the spatial light modulators 36, 38, 40, 42, 44 and 46. As will be described in greater detail below, the accumulator 16 accumulates light beam data that can then be shifted by means of a clock signal supplied by a clock generator 83 to the data output register 18 via the output interface bus 88. The accumulator 16 also includes circular shift bus 86 and lateral shift bus 84 to permit a wide variety of shift and sum operations to be performed within the accumulator 16 during the operation of the optical data processor 20.
The data output register 18 is preferably a high speed analog-to-digital converter, shift register and buffer that channels the shifted output data from the accumulator 16 to the processor output via the processor data output bus 90.
As should be well apparent from the foregoing, the microcontroller 12 possesses full control over the optical data processor 20. Any desired data can be provided to any specific combination of spatial light modulators to implement a desired data processing algorithm. Of particular facility is that only those spatial light modulators required for the performance of any particular optical data processing algorithm need be actively utilized in the optical data processor 20 in accordance with the present invention. Spatial light modulators within the optical data processor 20 may be provided with appropriate data via their respective data registers to uniformly maintain the spatial light modulators at their maximum transmissivity. Consequently, selected spatial light modulators may be effectively removed from the optical data processor by their appropriate data programming. Thus, the optical data processing system 10 provides an extremely flexible environment for the performance of optical data processing computations. The structure of an exemplary optical data processor 20 fabricated in accordance with the preferred optical processor embodiment of the present invention is shown in FIG. 2. The embodiment shown is exemplary as including substantially all of the principle components that may be incorporated into any preferred embodiment of the optical processor.
The components of the optical data processor may be functionally grouped as parts of a light source 91, SLM stage 92 and data beam receiver 93. The light source 91 essentially includes the flat panel light source 14 and, optionally, a light beam buffer component 94. The flat panel light source 14 is preferably an electroluminescent display panel or, alternately, a gas plasma display panel or LED or LED array or laser diode or laser diode array. The buffer component 94 is preferably utilized to grade the light produced by the flat panel display panel into a spatially uniform optical beam. Where a gas plasma display is utilized, the buffer component 94 may further function to insulate the remainder of the optical data processor 20 from any heat generated by the plasma display 14. In either case, the buffer component 94 is preferably an optical glass plate having a thickness of approximately 0.25 inch.
The bulk of the optical data processor 10 is formed by a serial stack of SLM stages, of which SLM stage 92 is representative. While each stage is preferably identical in terms of their component composition, the SLM of each is the only essential component. Preferably, the SLM is a rigid structure requiring no additional support. In such embodiments, the SLMs may be placed immediately adjacent one another, separated only by a thin insulating optically transparent layer, yielding an optimally compact multistage stack of spatial light modulators. However, where the spatial. light modulators are, for example, of a material possessing insufficient structural strength to provide for their own support, the stage 92 preferably further includes a supporting fiber optic plate 102. The fibers of the fiber optic plate 102 are, of course, aligned with their cylindrical axes parallel the major axis of the optical data processor 20. Also, in such embodiments utilizing a fiber optic plate 102 and where the significant operation of the spatial light modulator is accomplished through the polarization modulation of the light beam, a polarizer 64 is preferably interposed between the SLM 44 and fiber optic plate 102. The polarizer 64 further permits the utilization of an unpolarized optical data beam source 14 in local polarization vector data representation embodiments of the present invention. If the principle of operation of the spatial light modulation is light absorption (instead of polarization rotation), then there is no need for the polarizers. The data beam receiver 93 essentially includes an accumulator component 16. The accumulator 16 is preferably a solid state matrix array of optical detectors. In particular, the optical detector array is preferably a two-dimensional shift register array of conventional charge coupled devices (CCDs) provided at an array density equivalent to the effective resolution of the optical data processor 20. The use of a CCD array is preferred both for its charge accumulation, i.e., data summing, capability as well as for the ease of fabricating CCD shift register circuitry that can be directly controlled by the microcontroller 12. Further, the use of the CCD array permits substantial flexibility in the operation of the accumulator 16 by permitting data shifted out of the accumulator 16 and onto the data return bus 88 to be cycled back into the accumulator 16 via the circular shift data bus 86. Additionally, the accumulator 16 possesses the desirable flexibility through the use of adjacent register propagation path interconnections to permit lateral cycling of the data contained therein via the lateral shift data bus 84 generally as indicated in FIG. 1. Consequently, the accumulator 16 can be effectively utilized in the execution of quite complex optical data processing algorithms involving shift and sum operations under the direct control of the microcontroller 12.
The data beam receiver 93 may optionally include a fiber optic plate 122 as may be desirable in interconnecting the accumulator 16 with the SLM 44 of the last stage 92 of the optical data processor 20.
The preferred embodiments of the two one-dimensional spatial light modulators are shown in FIGS. 3 and 4. The spatial light modulator 130 shown in FIG. 3 includes an electro-optic element 132 preferably having two major parallel opposing surfaces upon which stripe electrodes 136 and potential reference plane 140 are provided respectively. The electro-optic element 132 may be a transmission mode liquid crystal light valve though preferably it is a solid state electro-optic material, such as KD2PO4 or BaTiO3. This latter material polarization modulates light locally in proportion to the longitudinal and transverse voltage potential applied across that portion of the material that the light passes through. This material characteristically possesses sufficient structural strength to be adequately self-supporting for purposes of the present invention when utilized as electro-optic elements 132 provided at a thickness of approximately 5 to 10 mil for a major surface area of approximately one square inch. As the active regions of the electro-optic element 132 necessarily lay between each of the stripe electrodes 136 and the reference plane electrode 140, the electrodes 136, 140 are preferably of a highly conductive transparent material such as indium tin oxide. Contact to the electrodes 136, 140 is preferably accomplished through the use of separate electrode leads 134, 138, respectively, that are attached using conventional wire bonding or solder bump interconnect technology.
A variation of the spatial light modulator 130 provides a zero dimensional, or uniform, spatial light modulator that is of particular utility in the present invention. By commonly connecting the stripe electrode leads 134, the transmissivity of the electro-optic material 132 will be uniformly modulated at all pixel locations. Alternately, a single electrode covering the entire major surface of the electro-optic material 132 may be substituted for the stripe electrodes 136. FIG. 4 illustrates an alternate one-dimensional spatial light modulator. This spatial light modulator significantly differs from that of FIG. 3 by the relative placement of the signal 156 and potential reference 158 electrodes on the two major surfaces of the electro-optic element 152. On each major surface, a reference potential electrode 158 is interposed between pairs of the signal electrodes 156 to form an interdigitated electrode structure that is essentially identical on both major surfaces of the electro-optic element 152. The active portions of the electro-optic element 152 lie between each of the signal electrodes 156 and their surface neighboring reference potential electrodes 158. Thus, the achievable electro-optic effect is enhanced through the utilization of both surfaces of the electro-optic element 152. Further, as the active portions of the electro-optic element 152 are not shadowed by the signal electrodes 156, all of the electrodes 156, 168 may be of an opaque conductive material, such as aluminum, that may be further advantageously utilized to effectively mask the active regions of the electro-optic element 152. That is, the electrodes 156, 158 may be utilized to block the respective pixel edge portions of the data beam as they diverge while passing through the electro-optic element 152.
Similar to the spatial light modulators 130 of FIG. 3, the electro-optic element 152 may be either a liquid crystal light valve or a solid state electro-optic material. For reasons of faster electro-optic response time, greater structural strength, and ease of fabrication, transverse field polarization modulation electro-optic materials, such as represented by LiNbO3, LiTaO3, BaTiO3, SrxBa(1-x)NbO3 and PLZT are preferred. These materials are believed to possess the generally equivalent structural strength characteristics as the polarization modulation material KD2PO4 described above. Electrode leads to the electrode strips 156, 158 are again preferably attached using conventional wire bonding or solder bump interconnect technology.
The versatility of the present invention in providing for the performance of a wide variety of complex data processing functions, as embodied in unique optical processing algorithms, is best illustrated with reference to FIG. 5. In order to facilitate the description of the present invention, a preferred embodiment of the optical data processor 20 is functionally illustrated as a series of planes A, B, C, D, E and F, each plane parallel to the X and Y axis and distributed along the Z axis of the coordinate system 200. For the sake of simplicity of description, the optical data processor 20 is shown as having an effective resolution of three by three pixels. As illustrated, planes A, B and C contain registers 212, 214, 218 interconnected by buses 234, 236, 238 to one-dimensional spatial light modulators 202, 204, 206 and to the microcontroller 12 by buses 222, 224, 226, respectively. The registers 212, 214, 216 each preferably includes a three by three pixel buffer array. The A and B plane one-dimensional spatial light modulators 202, 204 provide for the modulation of three pixel rows (parallel to the X axis). The spatial light modulator 206 of plane C is distinguished as providing for the modulation of three pixel columns (parallel to the Y axis). A two-dimensional spatial light modulator 208 driven by register 218 via bus 240 is provided in plane D with both being interconnected with the microcontroller 12 by the bus 230. Since, as will be demonstrated below, the operation of the two-dimensional spatial light modulator is effectively static with respect to the other planes of the optical data processor, the necessity of high speed independent addressing of the array electrodes is substantially obviated. Rather, simpler shift register mode propagation of data may be utilized in the operation of the two-dimensional spatial light modulator 208. Consequently, the construction constraints and complexity limitations in the reliable fabrication of high resolution matrix spatial light modulators are greatly eased for purposes of the present invention.
Plane E includes the three by three pixel register 220 that is interconnected with a uniform, zero-dimensional spatial light modulator 210 via the single pixel bus 242 and both with the microcontroller 12 via the bus 232.
Finally, a matrix array accumulator 14 is provided in plane F. As above, circular 86 and lateral 84 shift buses are provided to permit flexible sum and shifting operations to be performed under the control of the microcontroller 12.
The flexibility and versatility of the present invention is illustrated by its adaptation to perform the representative algorithms described below. Each algorithm functions to process data representable as an optical image. While the functions realized by the generation of the resultant optical images may be well known, their respective algorithmic performance is unique and particular to the present invention. Function 1 :
A two-dimensional Fourier transform of two-dimensional data, appropriate for two-dimensional spectral analysis, is performed by: Initialize
1. load the two-dimensional data into the register 216 of plane C, apply the row 3 data to the respective columns of the SLM 206; 2. load the Fourier transform coefficients for the first dimension analysis into the register 212 of plane A, apply the column 3 data to the respective rows of the SLM 202;
3. load all other registers 214, 218, 220 of the optical data processor 20 with uniform data corresponding to maximum spatial light modulator 204, 208, 210 transmissivity;
4. clear the accumulator 14 of plane F;
Process
5. sum the current optical pixel products of the optical data beam with the corresponding previous pixel product sums;
6. column shift the data present in the register 212 by one column in a given (for example, right) direction, apply the new column 3 data to the respective rows of the SLM 202;
7. row shift the data present in the register 216 by one row in a given (for example, up) direction, apply the new row 3 data to the respective columns of the SLM 206;
8. repeat steps 5 through 7 for each row of the two-dimensional data stored in register 216 of plane C; 9. transfer the matrix array data summed into the accumulator 14 of plane F into the register 216 of plane C, apply the row 3 data to the respective columns of SLM 206; 10. load the Fourier transform coefficients for the second dimension analysis into the reg ister 212 of plane A, apply the column 3 data to the respective rows of the SLM 202; 11. repeat steps 5 through 7 for each row of the two-dimensional data stored in register 216 of plane C; and
Provide resultant image 12. transfer the matrix array data summed into the accumulator 14 of plane F to the microcontroller 12.
Function 2:
A two-dimensional cross correlation of two-dimensional data, appropriate for image recognition, is performed by:
Initialize
1. load the two-dimensional data into the register 220 of plane E, apply the data from a given single pixel corresponding location (for example, 1,3) and apply to the uniform electrode of the SLM 210;
2. load the two-dimensional correlation mask data into the register 218 of plane D, apply the data to the respective pixel locations of the SLM 208;
3. load all other registers 212, 214, 216 with uniform data corresponding to maximum spatial light modulator 202, 204, 206 transmissivity; 4. clear the accumulator 14 of plane F; Process
5. sum the current optical pixel products of the optical data beam with the corresponding previous pixel product sums; 6. column shift the data present in the register
220 by one column in a given direction (for example, right), apply the new data from the given single pixel corresponding location to the SLM 210; 7. column shift the sums present in the accumulator
14 by one column in the same direction as register 220 is shifted; 8. repeat steps 5 through 7 for each column of data stored in the register 220 of plane E; 9. row shift the data present in the register
220 by one row in a given direction (for example, up), apply the new data from the given pixel corresponding location to the SLM
210; 10. row shift the sums present in the accumulator
14 by one row in the same direction as register
220 is shifted;
11. repeat steps 8 through 10 for each row of data stored in the register 220 of plane E; and
Provide resultant images
12. transfer the matrix array data summed into the accumulator 14 of plane F to the microcontroller 12. Function 3 :
A one-dimensional sliding window cross ambiguityfunction calculation with respect to one-dimensional data is performed by: Initialize
1. load the real part of the Fourier transform coefficient matrix into the register 212 of plane A, apply the column 3 data to the respect ive rows of the SLM 202; 2. load each row of the register 216 of plane C with the identical fixed length, one-dimens ional reference data template, apply the row 3 data to the respective columns of the SLM 206;
3. load each row of the register 214 of plane B with an identical portion of the continuously running one-dimensidnal input data, apply the column 3 data to the respective rows of the SLM 204;
4. load all other registers 218, 220 of the optical data processor 20 with uniform data corresponding to maximum spatial light modulator 208, 210 transmissivity;
5. clear the accumulator 14 of plane F;
Process
6. sum the current optical pixel products of the optical data beam with the corresponding previous pixel product sums;
7. column shift the data present in the register 212 of plane A by one column toward column 3, apply the new data present in column 3 to the respective rows of the SLM 202, recirculate the column data shifted out of column 3 and store in column 1 of the register 212; 8. column shift the data present in the register 214 of plane B by one column toward column 3, load each pixel location of column 1 of register 214 with the next sequential input datura, apply the new data present in column 3 to the respective rows of the SLM 204; 9. column shift the sums present in the accumulator 14 by one column toward column 3, clear the pixel corresponding sums of column 1 of the accumulator 14, retain external to the optical data processor 20 the data shifted out of column 3 as to last column of the most recent sliding window cross-ambiguity function matrix calculated for the corresponding portion of the input data stream; and
10. repeat steps 6 through 9 for each datum taken from the input data stream as buffered through the register 214 of plane B updating the most recent sliding window across ambiguity function matrix with each column of data shifted out of the accumulator 14.
Each of the above algorithmic examples of the methods of the present invention progressively build on the particular aspects of the present invention as may be illustrated in their preceding examples. Accordingly, the present invention is readily extensible to the performance of other specific optical data processing computations. Thus, a method of performing complex optical data processing calculations that is adaptable to the performance of a wide variety of specific optical data processing functions has been described. In view of the above teachings, persons of skill in the optical arts will readily appreciate that many modifications and variations of the method of the present invention are possible and contemplated. Accordingly, the present invention may be practiced other than as specifically described above without departing from the nature and scope of the present invention as set forth in the appended claims.

Claims

CLAIMSWhat is Claimed is:
1. A method of performing optical computations using a plurality of spatial light modulators to impress images corresponding to data onto a data beam, said method comprising the steps of: a) applying respective data to a subset of said modulators to impress corresponding data images onto said beam; and b) applying uniform data to the remaining ones of said modulators so as to impress corresponding uniform data images onto said beam such that the computation performed is dependent on the data applied to the subset of said modulators.
2. The method of Claim 1 further comprising the steps of: a) sequentially providing data to be applied to a first one of said subset of said modulators; b) sequentially providing data to be applied to a second one of said subset of said modulators; and c) continuously providing uniform data to be applied to a third one of said modulators.
3. The method of Claim 2 wherein said modulators spatially represent the data applied thereto, wherein an accumulator is used to sum the spatially represented data as impressed onto said beam and wherein said modulators include one and two-dimensional spatial light modulators for selectively impressing data images onto said beam as rows and columns oriented mutually orthogonal to said beam, said method further comprising the steps of: a) sequentially shifting the data summed into said accumulator with respect to the rows of said modulators; and b) summing the data spatially represented on said beam with the corresponding shifted spatially summed data of said accumulator.
4. The method of Claim 3 further comprising the step recirculating the data provided to selected ones of said subset of said modulators so as to periodically reapply the data to the selected ones of said modulators.
5. A method of performing an optical computation using an optical processor capable of impressing a plurality of data images onto a data beam using spatial light modulators, including crossed one-dimensional spatial light modulators, said method comprising the steps of: a) sequentially providing first data to a first one-dimensional spatial light modulator so as to impress a first data image onto said beam; b) sequentially providing second data to a second one-dimensional spatial light modulator so as to impress a second data image onto said beam; and c) spatially summing the data represented by the combination of said first and second data images on said data beam with a sequential provision of said first and second data.
6. The method of Claim 5 further comprising the step of respectively shifting the spatially summed data with a sequential provision of said first and second data.
7. The method of Claim 6 wherein said step of respectively shifting the spatially summed data is further characterized as occurring with each sequential provision of said first and second data.
8. The method of Claim 5, 6 or 7 further comprising the step of providing uniform data to any unused ones of said spatial light modulators of said optical processor so as to correspondingly impress uniform data images onto said beam.
9. The method of Claim 6 wherein said optical processor further includes a two-dimensional spatial light modulator, said method further comprising the step of providing third data to said two-dimensional modulator so as to impress a third data image onto said beam.
10. The method of Claim 9 wherein said two-dimensional spatial light modulator is characterized as impressing said third data onto said beam as data image rows and columns thereof and wherein the step of providing said third data further includes the step of shifting said third data along the rows of said two-dimensional spatial light modulator with each sequential provision of said first and second data.
11. The method of Claim 10 wherein the step of providing said third data further includes the step of recirculating that portion of said third data effectively shifted from the last row of said two-dimensional spatial light modulator so as to provide that portion of said third data to the first row of said two-dimensional spatial light modulator.
12. The method of Claim 10 or 11 further comprising the step of providing uniform data to any unused ones of said spatial light modulators so as to correspondingly impress uniform data images onto said data beam.
13. A method of performing a two-dimensional Fourier transform of two-dimensional data on a data beam using a plurality of spatial light modulators and a spatial accumulator, said method comprising the steps of: a) buffering the Fourier transform coefficient matrix for the first data dimension; b) buffering the two-dimensional data matrix to be transformed; c) applying the last matrix column buffered coefficients to the respective rows of a first one-dimensional spatial light modulator; d) applying the last matrix row of the buffered data to be transferred to the respective columns of a second one-dimensional spatial light modulator; e) providing uniform data to all remaining ones of said spatial light modulators; f) summing into the accumulator the products of the intersecting data provided on said first and second one-dimensional spatial light modulator as effectively impressed on, combined, and received from said data beam; g) respectively recirculating said two-dimensional data matrix and said coefficient matrix so as to provide new last columns and rows of respective coefficients and data to be applied to said first and second one-dimensional spatial light modulators; h) repeating steps c) through g) for each row of the two-dimensional data; i) buffering the summed first data dimension resultant data from said accumulator in place of the original two-dimens ional data ; j) buffering the Fourier transform coefficient matrix for the second data dimensional in place of that for the first data dimension; and k) repeating steps c) through g) for each row of the summed first data dimension resultant data modulators.
14. A method of performing a two-dimension cross correlation of two-dimensional data on a data beam using a plurality of spatial light modulators and a spatial accumulator, said method comprising the steps of: a) buffering the two-dimensional correlation mask data matrix; b) buffering the two-dimensional data matrix to be correlated; c) applying the buffered mask data matrix to the corresponding spatial positions of a two-dimensional spatial light modulator; d) applying a datum of the data matrix to be correlated, obtained from a predetermined row and column buffer position, to a zero-dimensional spatial light modulator; e) providing uniform data to all remaining ones of said spatial light modulators; f) summing into said accumulator the products of the intersecting correlation mask data matrix and said datum of the data matrix to be correlated, as provided to said two and said zero-dimensional spatial light modulators, respectively, to produce thereby cumulative two-dimensional resultant data; g) recirculating said buffered two-dimensional data matrix to be correlated in a first data matrix direction so as to provide a new datum at said predetermined row and column buffer position; h) recirculating said cumulative two-dimensional resultant data similarly in said first data matrix direction; i) repeating steps c) through h) for each row or column in said first data matrix direction of the two-dimensional data matrix to be correlated; j) recirculating said buffered two-dimensional data to be correlated in a second data dimension so as to provide a new datum at said predetermined row and column buffer position; k) recirculating said cumulative two-dimensional resultant data similarly in said second data matrix dimension; and
1) repeating steps i) through k) for each row or column in said second data matrix direction of said two-dimensional data matrix to be correlated.
15. A method of performing a one-dimensional, sliding window cross ambiguity function calculation for one-dimensional data on a data beam using a plurality of spatial light modulators and a spatial accumulator, comprising the steps of: a) buffering a two-dimensional Fourier transform coefficient mask data matrix; b) row buffering a one-dimensional reference data template; c) row buffering an initial portion of a one-dimensional input data stream; d) applying the respective last matrix column buffered coefficients to respective rows of a first one-dimensional spatial light modulator; e) applying the respective buffered row reference template data to the corresponding columns of a second one-dimensional spatial light modulator; f) applying to the respective columns of a third one-dimensional spatial light modulator, corresponding datum from a contiguous portion of said input data stream; g) providing uniform data to all remaining ones of said spatial light modulators; h) summing into said accumulator the products of the intersecting coefficient mask matrix data, said row reference template data, and said contiguous portion of said input data stream as provided to said first, second, and third one-dimensional spatial light modulators, respectively, to produce thereby cumulative two-dimensional resultant data matrix; i) sequentially shifting the next input data stream datum into said buffered portion so as to shift the application of said contiguous portion of said input stream in a predetermined row data shift direction; j) recirculating said buffered coefficient mask data matrix in said predetermined row shift data direction so as to provide the next sequential column of coefficient matrix to be applied to said first one-dimensional spatial light modulator; k) shifting said cumulative two-dimensional resultant data matrix in said predetermined row data shift direction and clearing the first matrix column of the resultant data matrix corresponding to the column of said third one-dimensional spatial light modulator to which the next input data stream datum is applied; and l) repeating steps d) through k) and sequentially buffering the last matrix column data of said two-dimensional resultant data matrix shifted out during step k) to form a two-dimensional most recent sliding window cross-ambiguity resultant data matrix.
EP86900432A 1985-03-18 1985-12-05 Programmable methods of performing complex optical computations using data processing system Expired EP0215008B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US71306385A 1985-03-18 1985-03-18
US713063 1985-03-18

Publications (2)

Publication Number Publication Date
EP0215008A1 true EP0215008A1 (en) 1987-03-25
EP0215008B1 EP0215008B1 (en) 1991-03-27

Family

ID=24864601

Family Applications (1)

Application Number Title Priority Date Filing Date
EP86900432A Expired EP0215008B1 (en) 1985-03-18 1985-12-05 Programmable methods of performing complex optical computations using data processing system

Country Status (5)

Country Link
EP (1) EP0215008B1 (en)
JP (1) JPS62502067A (en)
DE (1) DE3582329D1 (en)
IL (1) IL77384A0 (en)
WO (1) WO1986005608A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63502142A (en) * 1986-01-22 1988-08-18 ヒユ−ズ・エアクラフト・カンパニ− Optical analog data processing system for bipolar and complex data processing
US4800519A (en) * 1986-03-05 1989-01-24 Hughes Aircraft Company Optical data processing systems and methods for matrix inversion, multiplication, and addition
US10140720B1 (en) 2016-12-30 2018-11-27 X Development Llc Integrated optical correlator

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3989355A (en) * 1975-01-21 1976-11-02 Xerox Corporation Electro-optic display system
US4344675A (en) * 1980-05-29 1982-08-17 Rockwell International Corporation Optical signal processing device
DE3218244C2 (en) * 1982-05-14 1985-08-08 Messerschmitt-Bölkow-Blohm GmbH, 8000 München Optical data processing device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO8605608A1 *

Also Published As

Publication number Publication date
DE3582329D1 (en) 1991-05-02
EP0215008B1 (en) 1991-03-27
IL77384A0 (en) 1986-07-31
WO1986005608A1 (en) 1986-09-25
JPS62502067A (en) 1987-08-13

Similar Documents

Publication Publication Date Title
US4800519A (en) Optical data processing systems and methods for matrix inversion, multiplication, and addition
US4603398A (en) Matrix-matrix multiplication using an electrooptical systolic/engagement array processing architecture
US4607344A (en) Triple matrix product optical processors using combined time-and-space integration
US4747069A (en) Programmable multistage lensless optical data processing system
US5339090A (en) Spatial light modulators
EP0579356B1 (en) Optical information processor
US4764891A (en) Programmable methods of performing complex optical computations using data processing system
US4843587A (en) Processing system for performing matrix multiplication
US4707743A (en) Method and apparatus for image conversion with multiple exposures for filtering
EP0399753B1 (en) Neural networks
EP0256033B1 (en) Optical analog data processing systems for handling bipolar and complex data
EP0405815B1 (en) Spatial light modulators
EP0215008B1 (en) Programmable methods of performing complex optical computations using data processing system
WO1982004369A1 (en) Light valve apparatus
EP0215822B1 (en) Programmable multistage lensless optical data processing system
US7173662B1 (en) Foveating imaging system and method employing a spatial light modulator to selectively modulate an input image
JPH0547017B2 (en)
Karim et al. Electrooptic displays for optical information processing
Cao Real-time electro-optical pattern recognition and optical computing
Zhang et al. Massively parallel optical interconnect for long data stream convolution
JP2778176B2 (en) Optical arithmetic unit
JPH03256032A (en) Optical arithmetic unit
Evans et al. Optical'Dequeues' For A'R And F'Systolic LU-Factorization Of Tridiagonal Systems
Lueder LCD based electro-optical processor for discrete algorithms
Yang et al. Fully parallel optical matrix-matrix multiplier using spherical lens array

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 19861008

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): DE FR GB IT NL

17Q First examination report despatched

Effective date: 19890602

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB IT NL

REF Corresponds to:

Ref document number: 3582329

Country of ref document: DE

Date of ref document: 19910502

ITF It: translation for a ep patent filed
ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed
PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 19941108

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 19941116

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 19941122

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 19941231

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Effective date: 19951205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Effective date: 19960701

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 19951205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Effective date: 19960830

NLV4 Nl: lapsed or anulled due to non-payment of the annual fee

Effective date: 19960701

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Effective date: 19960903

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST