US20020122595A1 - Apparatus and method for radial and angular or rotational analysis of images for shape content and matching - Google Patents

Apparatus and method for radial and angular or rotational analysis of images for shape content and matching Download PDF

Info

Publication number
US20020122595A1
US20020122595A1 US10/051,364 US5136402A US2002122595A1 US 20020122595 A1 US20020122595 A1 US 20020122595A1 US 5136402 A US5136402 A US 5136402A US 2002122595 A1 US2002122595 A1 US 2002122595A1
Authority
US
United States
Prior art keywords
image
optic
active
light
light energy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/051,364
Other languages
English (en)
Inventor
Rikk Crill
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Look Dynamics Inc
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/326,362 external-priority patent/US6445822B1/en
Priority claimed from US09/536,426 external-priority patent/US6678411B1/en
Priority to US10/051,364 priority Critical patent/US20020122595A1/en
Application filed by Individual filed Critical Individual
Assigned to LOOK DYNAMICS INC reassignment LOOK DYNAMICS INC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CRILL, RIKK
Assigned to LOOK DYNAMICS, INC. reassignment LOOK DYNAMICS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CRILL, RIKK
Publication of US20020122595A1 publication Critical patent/US20020122595A1/en
Priority to RU2004125168/09A priority patent/RU2300144C2/ru
Priority to AU2003207576A priority patent/AU2003207576B2/en
Priority to PCT/US2003/001281 priority patent/WO2003062907A2/fr
Priority to CNB038064529A priority patent/CN100354879C/zh
Priority to EP03705791A priority patent/EP1468326A2/fr
Priority to CA2473500A priority patent/CA2473500C/fr
Priority to JP2003562708A priority patent/JP5244283B2/ja
Priority to KR1020047011091A priority patent/KR100971808B1/ko
Priority to US10/385,192 priority patent/US7103223B2/en
Priority to IL163016A priority patent/IL163016A/en
Priority to US11/470,230 priority patent/US7302100B2/en
Priority to US12/401,461 priority patent/USRE42070E1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on liquid crystals, e.g. single liquid crystal display cells
    • G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
    • G02F1/1333—Constructional arrangements; Manufacturing methods
    • G02F1/1343—Electrodes
    • G02F1/134309—Electrodes characterised by their geometrical arrangement
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
    • G02B27/46—Systems using spatial filters
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
    • G06V10/431—Frequency domain transformation; Autocorrelation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/88—Image or video recognition using optical means, e.g. reference filters, holographic masks, frequency domain filters or spatial domain filters
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/88—Image or video recognition using optical means, e.g. reference filters, holographic masks, frequency domain filters or spatial domain filters
    • G06V10/92—Image or video recognition using optical means, e.g. reference filters, holographic masks, frequency domain filters or spatial domain filters using spatial domain filters, e.g. joint transform correlators
    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on liquid crystals, e.g. single liquid crystal display cells
    • G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
    • G02F1/13306—Circuit arrangements or driving methods for the control of single liquid crystal cells
    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on liquid crystals, e.g. single liquid crystal display cells
    • G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
    • G02F1/1333—Constructional arrangements; Manufacturing methods
    • G02F1/133362—Optically addressed liquid crystal cells
    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F2203/00—Function characteristic
    • G02F2203/12—Function characteristic spatial light modulator
    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F2203/00—Function characteristic
    • G02F2203/50—Phase-only modulation

Definitions

  • This invention relates generally to spatial light modulators and, more particularly, to a spatial light modulator with radially oriented active light modulating sectors for radial and angular analysis of beams of light, including Fourier transform optic patterns, for uses such as characterizing, searching, matching or identifying shape content of images.
  • That system with the rotating, radially oriented, slit does perform the task of characterizing and encoding images by shape content of the images quite well and quite efficiently.
  • resolution of spatial frequency of an image at each angular orientation of the rotating slit is not as good as some applications or uses of such a system might require.
  • the spinning mask or wheel with an associated drive mechanism like all mechanical devices, has stability and long term reliability issues, not to mention size and weight requirements.
  • a more specific object of this invention is to provide an improved apparatus and method for spatial analysis of Fourier transform optical patterns of images for shape content of such images.
  • Another specific object of this invention is to provide an improved apparatus and method for characterizing and encoding images by shape content for storing, searching, comparing, matching, or identifying images.
  • the apparatus of this invention includes a spatial light modulator with a plurality of addressable, active optic elements that extend radially at various angular orientations in relation to an axis.
  • the active optic elements are preferably shaped to modulate portions of light beams incident on discrete sectors of an active optic area on which the beam of light can be focused. Therefore, active optic modulators in the shape of individual sectors, i.e., essentially wedge-shaped, are preferred, although other shapes are also feasible and, in special circumstances, possibly even more desirable, such as rectangular for better resolution or curved for detection of curved shape content of an image.
  • the radially extending wedges or rectangles of the active optic area can be comprised of individually addressable segments, which can be activated separately or in groups, depending on the resolution desires.
  • Wedge-shaped sectors can comprise segments of smaller, truncated wedge-shaped active optic elements or groups of sensors in pixel arrays that, in composite, form such shapes.
  • Rectangular areas can also comprise smaller rectangular segments or composited groups of sensors in pixel arrays to form such radially extending, angularly spaced, active optic components or areas.
  • an optic pattern that is a Fourier transform of the image is focused on the active optic area, and radially disposed portions of the Fourier transform optic pattern at various angular orientations are selected and isolated by the spatial light modulator for detection of shape content of the image that is aligned with such angular orientations.
  • the intensities of light detected from such respective portions are characteristic of such shape content and can be recorded, stored, or used to compare with similarly analyzed shape content of other images to find and identify matches or near matches of images with such shape content.
  • Optional image pre-processing to add ghost images at various radial and angular relationships to the image and at various light intensities can enhance detectability of shape content and can enable near matching of images with similar shape content.
  • FIG. 1 is an isometric view of a segmented radial spatial light modulation device according to this invention illustrated with a beam of light focused on the light modulating components in the active optic area of the device;
  • FIG. 2 is a front elevation view of the preferred light modulating components in the active optic area of the segmented radial spatial light modulator device of this invention in the shape of segmented sectors that are oriented to extend radially at various angular orientations in relation to a central axis;
  • FIG. 3 is an enlarged, front elevation view of one sector of the active, light modulating components of the segmented radial spatial light modulator device
  • FIG. 4 is a cross-sectional view of a portion of an active optic sector of a segmented radial spatial light modulator of the present invention taken substantially along section line 4 - 4 of FIG. 3;
  • FIG. 5 is a schematic diagram of an optical image characterizer in which a segmented radial optical analyzer device according to this invention is illustrated in an application for characterizing and encoding optical images by shape content to exemplify its structure and functional capabilities;
  • FIGS. 6 a - c include diagrammatic, elevation view of the active light modulating components of the segmented radial spatial light modulator device to illustrate a use of an outer segment of a vertically oriented sector of the light modulation components of the segmented radial spatial light modulator device of this invention along with diagrammatic views of an image being characterized and a resulting detectable optic pattern that is characteristic of some of the vertically oriented shape content of the image;
  • FIGS. 7 a - c include diagrammatic, elevation views similar to FIGS. 6 a - c , but illustrating a use of a near inner segment of the vertical sector;
  • FIGS. 8 a - b include diagrammatic, elevation views similar to FIGS. 6 a - c , but illustrating a use of a near outer segment of an active optic sector that is oriented 45 degrees from vertical;
  • FIGS. 9 a - c include diagrammatic, elevation views similar to FIGS. 6 a - c , but illustrating a use of the outer segment of the horizontal oriented active optic sector;
  • FIGS. 10 a - c include diagrammatic, elevation views similar to FIGS. 6 a - c, but illustrating a use of the outer segment of the active optic sector that is oriented 191.25 degrees from vertical;
  • FIG. 11 is a diagrammatic elevation view similar to FIG. 6 a , but illustrating a modified embodiment in which the active optic segments are rectangular instead of wedge-shaped;
  • FIG. 12 is a diagrammatic elevation view of another embodiment in which groups of individually addressable light sensors in a pixel array of sensors can be activated together in locations that simulate sectors or segments of sectors to achieve angular and/or spatial analysis of a light beam for characterization of an image by shape content according to this invention
  • FIG. 13 is a cross-section view similar to FIG. 4, but illustrating a modification in which a modulated light beam passes through, instead of being reflected by, a segmented radial spatial light modulator in accordance with this invention
  • FIGS. 14 a - c illustrates an optional ghosting technique for enhancing optical power transmission to improve shape information detection capability and to provide graded shape content characterization to enable identification of near matches of shape content in various images;
  • FIGS. 15 a - c illustrate the ghosting technique of FIGS. 14 a - c applied to a slightly more complex image.
  • a segmented radial spatial light modulator (SLM) device 50 is illustrated diagrammatically in FIG. 1 with a beam of light 27 ( p ) focused on the active optic area 54 in the center portion of the segmented radial SLM device 50 .
  • the segmented radial SLM device 50 is preferably, but not necessarily, constructed as an integrated circuit 52 mounted on a chip 56 equipped with a plurality of electrical pins 58 configured to be plugged into a correspondingly configured receptacle (not shown) on a printed circuit board (not shown).
  • the pins 58 are connected electrically by a plurality of wires 59 soldered to contact pads 55 of the integrated circuit 52 to enable addressing and operating optic components in the active optic area 54 , as will be discussed in more detail below.
  • FIG. 2 An enlarged elevation view of the active optic area 54 of the integrated circuit 52 is illustrated in FIG. 2, and an even more enlarged view of the active optic segments 502 , 504 , 506 , 508 of one sector 500 of the active optic area 54 is illustrated in FIG. 3.
  • the segmented radial SLM device 50 is capable of selectively isolating radially disposed portions of the incident light energy at various angular orientations in relation to a central axis 40 for detection, as will be explained in more detail below.
  • each of the active optic segments such as segments 520 , 504 , 506 , 508 of sector 500 in FIG. 3, are addressable individually through electrically conductive traces 503 , 505 , 507 , 509 , respectively, although the invention also can be implemented, albeit with less spatial frequency resolution, by a sector 500 comprising only one active optic modulator or by activating one or more of the individual segments simultaneously.
  • FIG. 4 is a partial cross-section of active optic segments 506 , 508 .
  • the light reflected by the activated segment 508 is designated as 61 ( s ) to indicate its s-plane polarization
  • light reflected by the non-activated segment 506 is designated as 61 ( p ) to indicate its p-plane polarization.
  • the structure and function of the segments 506 , 508 which are typical of all the segments of all the sectors 500 , 510 , 520 , 530 , 540 , 550 , 560 , 570 , 580 , 590 , 600 , 610 , 620 , 630 , 640 , 650 of the active optic area 54 , will be explained in more detail below.
  • a s-polarization plane is orthogonal to i.e., rotated 90° in relation to, a p-polarization plane and that such rotation of plane of polarization of a portion of a light beam 61 ( p ) (see FIG. 1) enables filtration or separation of that portion from the remainder of the light beam 61 ( p ), as will be explained in more detail below.
  • the system 10 for characterizing, encoding, and storing images by shape content of such images is an example application of the segmented radial SLM device 50 described above and is a part of this invention.
  • any number n of images 12 , 14 , . . . , n can be characterized and encoded by the shape content in such images, and such encoded shape information about each image can be stored, for example, in database 102 for subsequent searching, retrieval, and comparison to shape content of other images that is characterized and encoded in the same manner.
  • the images 12 , 14 , . . . , n can be in virtually any form, for example, visual images on photographs, films, drawings, graphics, arbitrary patterns, ordered patterns, or the like. They can also be stored and/or generated in or from digital formats or analog formats. Such images can have content that is meaningful in some manner when viewed by humans, or they can be meaningless or not capable of being interrupted by humans but characteristic of some other content, e.g., music, sounds, text, software, and the like. Essentially, any optic pattern of light energy intensities that can be manifested or displayed with discernable shape content can be characterized and encoded with this system 10 .
  • a sample image 12 which can be obtained from any source (e.g., Internet, electronic data base, web site, library, scanner, photograph, film strip, radar image, electronic still or moving video camera, and other sources) is entered into the optical image shape characterizer 10 , as will be described in more detail below.
  • the computer 20 in FIG. 5 is a preferred embodiment, but is also intended to be symbolic of any apparatus or system that is capable of queuing and moving images 12 , 14 , . . . , n into the image characterizer 10 .
  • the example image 12 of an automobile displayed on the video monitor 22 represents and is symbolic of any image that is placed in a process mode for characterizing and encoding its shape content according to this invention, although it should be understood that such display of the image being processed is not an essential feature of this invention.
  • the description that follows will, for the most part, refer only to the first image 12 for convenience and simplicity, but with the understanding that it could apply as well to any image 12 , 14 , . . . , n etc.
  • the image 12 is inserted into the optical image characterizer 10 in an image plane 19 that is perpendicular to the beam of light 27 emanating from the E-SLM 26 , i.e., perpendicular to the plane of the view in FIG. 5.
  • the images 12 , 14 , . . . , n are also shown in phantom lines in the plane of the view in FIG. 5, i.e., in the plane of the paper.
  • the image 12 can be entered into the optical image characterizer 10 by the computer 20 and E-SLM 26 , as will be described in more detail below.
  • the image 12 will undergo a significant transformation upon passing through the thin, positive lens 30 , also called the Fourier transform (FT) lens.
  • FT Fourier transform
  • a Fourier transform (FT) of the sample image 12 ′ rearranges the light energy of the optic pattern of image 12 ′ into a Fourier transform (FT) optic pattern 32 , which is unique to the image 12 ′, even though it is not recognizable as the image 12 ′ to the human eye and brain, and which can be characterized by intensities, i.e., amplitudes, of light energy distributed spatially across the optic pattern 32 .
  • the complex amplitude distribution of light energy 34 in the optic pattern 32 is the Fourier transform of the complex light distribution in the image 12 ′.
  • Image 12 ′ is a recreation of the image 12 in monochromatic, preferably coherent, light energy, as will be described in more detail below, although white light will also work.
  • Concentrations of intense light energy in the Fourier transform (FT) optic pattern 32 generally correspond to spatial frequencies of the image 12 ′, i.e., how closely together or far apart features in the image 12 ′ change or remain the same. In other words, spatial frequencies are also manifested by how closely together or far apart light energy intensities across the light beam 27 change or remain the same.
  • a shirt with a plaid fabric in an image i.e., having many small squares
  • a plain, single-color shirt not shown
  • portions of an image, such as the bumper and grill parts 35 of the automobile in image 12 ′ would have a higher spatial frequency than the side panel 36 portion of the automobile image 12 ′, because the bumper and grill parts 35 comprise many small pieces with various edges, curves, and other intricate changes within a small spatial distance, whereas the side panel 36 is fairly smooth and uniform over a large spatial distance.
  • Light energy from the finer and sharper details of an image tend to be dispersed farther radially outward from the optical center or axis 40 in the Fourier transformed image than light energy from more course or plain details of an image (less spatial frequency), such as the side panel 36 of the image 12 ′.
  • the amplitude of light energy 34 dispersed radially outward in the Fourier transform optic pattern 32 is related to the light energy of the corresponding portions of the optic pattern of image 12 ′ from which such light energy emanates, except that such light energy is concentrated into areas or bands 34 at the plane of the Fourier transform (FT) optic pattern 32 after they are refracted by the FT lens 30 , i.e., into bands of intense light energy separated by bands of little or no light energy, which result from constructive and destructive interference of the diffracted light energy.
  • FT Fourier transform
  • the intensity or amplitude of light energy from those high spatial frequency portions of the image 12 ′, which are dispersed by the FT lens 30 to the more radially outward bands of light energy 34 in the Fourier transform optic pattern 32 will be higher, i.e., brighter.
  • the intensity or amplitude of light energy from those high spatial frequency portions of the optic pattern of image 12 ′, which are dispersed by the FT lens 30 to the more radially outward bands of light energy 34 in the Fourier transform optic pattern 32 will be lower, i.e., not so bright.
  • the intensity or amplitude of light energy from those low spatial frequency portions of the optic pattern of image 12 ′ which are dispersed by the FT lens to the less radially outward bands of light energy 34 in the Fourier transform optic pattern 32 will be higher, i.e., brighter.
  • the intensity or amplitude of light energy from those low spatial frequency portions of the optic pattern of image 12 ′, which are dispersed by the FT lens 30 to the less radially outward bands of light energy 34 in the Fourier transform optic pattern 32 will be lower, i.e., not so bright.
  • the Fourier transform optic pattern 32 of the light emanating from the image 12 ′ (i) is unique to the image 12 ′; (ii) comprises areas or bands of light energy 34 concentration, which are dispersed radially from the center or optical axis 40 , that represent spatial frequencies, i.e., fineness of details, in the image 12 ′; (iii) the intensity or amplitudes of light energy 34 at each spatial frequency area or band in the Fourier transform optic pattern 32 corresponds to brightness or intensity of light energy emanating from the respective fine or course features of the image 12 ′; and (iv) such light energy 34 in the areas or bands of the Fourier transform optic pattern 32 are detectable in intensity and in spatial location by this invention.
  • this optical image characterizer 10 of this invention is designed to characterize an image 12 by shapes that comprise the image 12 .
  • additional spatial filtering of the Fourier transform light energy pattern 32 is used to detect and capture light energy emanating from the finer or sharper details or parts of such finer or sharper details in the image 12 ′, which are aligned linearly in various specific angular orientations.
  • Such spatial filtering can be accomplished in any of a number of different ways, as will be explained in more detail below, but an exemplary spatial filter arrangement for this function is included in a combination of the segmented radial spatial light modulator device 50 with the polarizing beam splitter 70 .
  • the segmented radial SLM device 50 rotates the plane of polarization of selected portions of the Fourier transform optic pattern 32 from p-plane polarization to s-plane polarization, or vice versa, as explained above, and the polarizing beam splitter 70 separates light energy of those portions that is isolated and polarized in one plane from the light energy of the rest of the Fourier transform optic pattern 32 that remains polarized in the other plane so that such light energy of the selected and isolated portions can be detected separately.
  • Such selected portions 61 ( s ) of the beam 27 ( p ) represent, i.e., emanated largely from, details or features of the image 12 ′, such as straight lines and short segments of curved lines, that align linearly with the angular orientation of the respective sectors 500 , 510 , 520 , 530 , 540 , 550 , 560 , 570 , 580 , 590 , 600 , 610 , 620 , 630 , 640 , 650 in which selected segments are located in the active optic area 54 of the segmented radial SLM 50 .
  • the reflected light energy 61 ( s ) will have emanated largely from details or features of the image 12 ′ that align linearly with the vertical orientation of the sector 500 in which segments 502 , 504 , 506 , 508 are positioned. Further, since the light energy 34 from higher spatial frequency content of the image 12 ′, e.g. , closely spaced bumper and grill parts 35 , are dispersed farther radially outward in the Fourier transform optic pattern 32 than light energy 34 from lower spatial frequency content, e.g.
  • the light energy in reflected light beam 61 ( s ) will also be characteristic of a confined range of such spatial frequency content of image 12 ′, depending on which segment of a sector is selected. For example, activation of outer segment 508 of sector 500 (FIG. 3), which is positioned farther radially outward from the optic axis 40 of the incident beam 27 ( p ) than segment 502 , will cause the light energy in reflected beam 61 ( s ) to be characteristic of higher spatial frequency content of vertically oriented features in image 12 ′, e.g. , vertical edges of bumper and grill parts 35 .
  • activation of inner segment 502 of sector 500 will cause the light energy in reflected beam 61 ( s ) to be more characteristic lower spatial frequency content of vertically oriented features in the image 12 ′, e.g. , the vertical rear edge of the trunk lid 37 .
  • the result is a filtered pattern 60 of light energy bands 62 that represent or are characteristic of the unique combination of features or lines in the content of image 12 ′ that corresponds to light energy of the FT optic pattern 32 at the radial distance of the selected segment and that align linearly with the sector in which the selected segment is positioned.
  • the segments of each sector such as segments 502 , 504 , 506 , 508 of sector 500 , provided the additional capability of scalar spatial filtering FT optic pattern 32 at different radial distances from the optic axis.
  • segments in different sectors of different angular orientations about the optic axis 40 will align linearly with features or lines in the image 12 ′ that have different angular orientations, as will be described in more detail below.
  • the light energy bands 62 in the filtered pattern 60 will change, as active optic segments in different sectors are selected and activated, to represent different features, details, edges, or lines in the optical pattern of image 12 ′ at various angular orientations, intricateness or fineness, and brightness, as will be explained in more detail below.
  • the light energy bands 62 if inverse Fourier transformed from the FT optic pattern 32 after the above-described spatial filtering 54 , will be located in the same spatially-related sites as the features in the original image 12 ′ from which such light energy emanated. For example, light energy in a band 62 in pattern 60 that originally emanated from bumper and grill parts 35 in image 12 ′, after spatial filtering with the vertical sector of the bumper and grill parts 35 in image 12 ′.
  • the spatially filtered light energy in bands 62 of the filtered pattern 60 can be detected by a photodetector 80 at any of the various angular orientations of the activated sectors and fed electronically to a computer 20 or other microprocessor or computer for processing and encoding. While only one photodetector 80 with an example 16 ⁇ 16 array 82 of individual photosensitive energy transducers 84 is illustrated in FIG. 5 and is sufficient for many purposes of this invention, other detector arrangements, for example, the two offset detector arrays described in co-pending patent application, Ser. No. 09/536,426, or one or more larger detector arrays, could also be used.
  • the computer 20 with input of information about the filtered optical patterns 60 , i.e., light energy intensity (I) distribution, from the detector array 82 , along with information about the image 12 (e.g. , identification number, source locator, and the like), information about the angular orientation (R) of the sector in which a segment is activated, and information about the radial distance or scale (S) of the activated segment relating to spatial frequency, can be programmed to encode the characteristics of the image 12 relating to the shape content of the image 12 .
  • information about the filtered optical patterns 60 i.e., light energy intensity (I) distribution
  • information about the image 12 e.g. , identification number, source locator, and the like
  • information about the angular orientation (R) of the sector in which a segment is activated e.g. , identification number, source locator, and the like
  • information about the angular orientation (R) of the sector in which a segment is activated e.g. , identification number, source
  • One useful format for encoding such information is by pixel of the filtered image 60 , including information regarding x, y coordinate location of each pixel, R otation (i.e., angular orientation of the sector in which a segment is activated, thus of the linear features of the image 12 that align with such angular orientation), and Intensity (i.e., amplitude of light energy from the filtered pattern 60 that is detected at each pixel at the angular orientation R.
  • a searchable flag such as a distortion factor X, can also be provided, as explained in more detail co-pending patent application, Ser. No. 09/536,426 or by the ghost image pre-processing feature of this invention, which will be explained in more detail below.
  • Such combination of angular orientation or rotation R, light energy intensity I for each pixel, and distortion factor X can be called a “RIXel” for short.
  • S cale i.e., spatial frequencies of image 12 content at such angular orientations
  • the combination can be called a “RIXSel”.
  • Each RIXel or RIXSel can then be associated with some identifier for the image 12 from which it was derived (e.g. , a number, name, or the like), the source location of the image 12 (e.g.
  • any other desired information about the image such as format, resolution, color, texture, content description, search category, or the like.
  • Some of such other information, such as color, texture, content description, and/or search category can be information input from another data base, from human input, or even from another optical characterizer that automatically characterizes the same image 12 as to color, texture, or the like—whatever would be useful for searching, finding, or retrieving image 12 or for comparing image 12 to other images.
  • Some, all, or additional combinations of such information about each image 12 , 14 . . . , n characterized for shape and encoded, as described above, can be sent by the computer 20 to one or more data base( s ) 102 .
  • data base( s ) 102 Several example data base architectures 104 , 106 , 108 for storing RIXel or RIXSel information about each image 12 , 14 , . . . , n are shown in FIG. 5, but many other architectures and combinations of information could also be used.
  • the image 12 has to be recreated with monochromatic, preferably coherent, light energy, e.g. , at image 12 ′, with a spatial light modulator (SLM) 26 illuminated with a beam of monochromatic light 24 from a light source 23 , such as a laser diode or gas diode.
  • SLM spatial light modulator
  • This feature of the invention could also be implemented with white light, although the resultant Fourier transform optic patterns and spatially filtered optic patterns would be more blurred than with monochromatic light. Therefore, while this description of the invention will proceed based on monochromatic, preferably coherent, light, it should be understood that white light is a suitable, albeit not a preferred, substitute.
  • the spatial light modulator (SLM) 26 can be optically addressable ( 0 -SLM), such as the one illustrated in co-pending patent application 09/536,426, or it can be electrically addressable (E-SLM) and driven, for example, by a computer 20 in FIG. 5 or by a video camera (not shown).
  • a spatial light modulator (SLM) can “write” an image into a polarized beam of light 25 by rotating or partially rotating the polarization plane of the light on a spatial basis across the beam 25 so that, upon reflection as beam 27 , it is either transmitted through, or reflected by, the polarization beam splitter 116 , depending on what is needed to create the image 12 ′ in monochromatic light.
  • the image plane is addressed on a spatial basis by incident light energy on a semiconductor material adjacent the polarization rotating material (usually a liquid crystal material), whereas, in an electrically addressable SLM 26 , the liquid crystal, polarization rotating material is addressed electrically on a pixel by pixel basis.
  • the pixel portions of the polarized light that have the plane of polarization rotated 45 degrees as they pass once through the liquid crystal material, whereupon such light is reflected and passed back through the liquid crystal again, where it is rotated another 45 degrees.
  • the pixels of light in polarized beam 25 that have their plane of polarization rotated in the SLM 26 are reflected and emerge from the SLM along the optical path 27 , which has an optic axis 40 that coincides with the optic axis of the incident beam 25 but in an optic pattern imposed by the E-SLM 26 that forms an image 12 ′ and with its plane of polarization rotated 90 degrees from the plane of polarization of the incident beam 25 .
  • the remaining pixels of light, which do not undergo rotation of the plane of polarization are also reflected, but they can be separated from those that have undergone rotation of plane of polarization, as will be explained below.
  • Various light intensities or brightnesses of the image 12 can be recreated in gray scales in image 12 ′ by partial rotations of plane of polarization.
  • the coherent light beam 24 from laser source 23 is passed first through a polarizer 28 to create a polarized beam of coherent light 25 with all the light polarized in one plane, such as, for example, but not for limitation, in the s-plane, as indicated by 25 ( s ).
  • the s-polarized beam 25 ( s ) is then passed through a spatial filter 110 comprised essentially of a pin hole 112 and a lens 114 to focus the beam 25 ( s ) on the pin hole 112 .
  • This spatial filter 110 is provided primarily to condition the beam 25 ( s ) to get a good Gaussian wavefront and, if necessary, to limit the power of the beam 25 ( s ).
  • Lens 114 a then columnates the light.
  • the beam 25 ( s ) is then passed through a polarizing beam splitter 116 , which reflects light polarized in one direction at plane 118 and transmits light polarized in the orthogonal direction.
  • the polarizing beam splitter 116 reflects s-polarized light and transmits p-polarized light, and it is oriented to reflect the s-polarized beam 25 ( s ) toward the electrically addressed spatial light modulator (E-SLM) 16 .
  • the monochromatic, preferably coherent, light beam 25 ( s ) incident on the E-SLM 36 provides the light energy that is utilized to carry the shape content of the image 12 ′ for further analysis, characterization, and encoding according to this invention.
  • computer 20 has the content of image 12 digitized, so the computer 20 can transmit digital signals via link 21 to the E-SLM 26 in a manner that addresses and activates certain pixels in the E-SLM 26 to “write” the image 12 ′ into reflected light beam 27 ( p ), as is understood by persons skilled in the art.
  • the addressed pixels rotate the plane of polarization by 90 degrees from the s-plane of incident beam 25 ( s ) to the p-plane of reflected beam 27 ( p ), or by some lesser amount for gray-scales, in a manner such that the reflected light energy with partially or fully 90 -degree polarization plane rotation is in an optical pattern of the image 12 ′.
  • the image 12 ′ could also be created with an E-SLM that operates in an opposite manner, i.e., the plane of polarization is rotated in reflected light, except where pixels are activated, in which case the computer 20 would be programmed to activate pixels according to a negative of the image 12 in order to write the image 12 ′ into reflected beam 27 .
  • the emerging beam 27 ( p ) of coherent light, carrying image 12 ′ is p-polarized instead of s-polarized or vice versa.
  • the positive Fourier transform (FT) lens 30 is positioned in the light beam 27 ( p ) and redistributes the monochromatic light energy from the image 12 ′ into its Fourier transform optic pattern 32 , which occurs at the focal plane of the FT lens 30 . Therefore, the segmented radial SLM 50 of this invention has to be positioned in the focal plane of the FT lens 30 , as indicated by the focal distance F in FIG. 5, and the FT lens 30 is also positioned the same focal distance F from the E-SLM 26 , so that the E-SLM 26 is also in a focal plane of the lens 30 .
  • the complex amplitude distribution of light energy 34 in the Fourier transform optic pattern 32 at the focal plane of the FT lens 30 is the Fourier transform of the complex amplitude distribution in the image 12 ′.
  • the Fourier transform optic pattern 32 has all of the light energy from the image 12 ′ distributed into the symmetrical pattern 32 based on the spatial frequencies of the image 12 ′, with intensities of the light energy in the various spatial frequency distributions 34 based on the light energy in the corresponding portions of the image 12 ′ where those respective spatial frequencies occur.
  • the Fourier transform optic pattern 32 is symmetrical from top to bottom and from left to right, so that each semicircle of the Fourier transform optic pattern 32 contains exactly the same distribution and intensity of light energy as its opposite semicircle.
  • Light energy from lower spatial frequencies in the image 12 ′ are distributed toward the center or optical axis 40 of the Fourier transform optic pattern 32 , while the light energy from higher spatial frequencies in the image 12 ′ are distributed farther away from the optical axis 40 and toward the outer edge of the pattern 32 , i.e., farther radially outward from the optic axis 40 .
  • Light energy from features in the image 12 ′ that are distributed vertically in the image 12 ′ to create those various spatial frequencies is likewise distributed vertically in the Fourier transform optic pattern 32 .
  • light energy from features in the image 12 ′ that are distributed horizontally in the image 12 ′ to create those various spatial frequencies is distributed horizontally in the Fourier transform optic pattern 32 . Therefore, in general, light energy from features in the image 12 ′ that are distributed in any angular orientation with respect to the optical axis 40 to create the various spatial frequencies in the image 12 ′ is also distributed at those same angular orientations in the Fourier transform optic pattern 32 .
  • such detections are characteristic of features or details in the image 12 ′ that are aligned linearly in such particular angular orientations.
  • the radial distributions of such detected light energy at each such angular orientation indicate the intricateness or sharpness of such linear features or details in the image 12 ′, i.e., spatial frequency, while the intensities of such detected light energy indicate the brightness of such features or details in the image 12 ′.
  • a composite of light energy detections at all angular orientations in the Fourier transform optic pattern 32 creates a composite record of the shapes, i.e., angular orientations, intricateness or sharpness, and brightness, of linear features that comprise the image 12 ′.
  • shape characteristics of images 12 , 14 , . . . , n for data base storing, searching, retrieval, comparison and matching to other images, and the like, it is not necessary to record such light energy detections for all angular orientations in the Fourier transform pattern 12 ′.
  • the segmented radial SLM 50 shown in FIG. 1, with its active optic sectors 500 , 510 , 520 , 530 , 540 , 550 , 560 , 570 , 580 , 590 , 600 , 610 , 620 , 630 , 640 , 650 shown in FIG. 2, is used to select only light energy from specific angular orientations in the Fourier transform optic pattern 32 for detection at any instant in time or increment of time on the detector array 82 .
  • the sector 500 in FIG. 1 with its active optic sectors 500 , 510 , 520 , 530 , 540 , 550 , 560 , 570 , 580 , 590 , 600 , 610 , 620 , 630 , 640 , 650 shown in FIG. 2
  • the sector 500 in FIG. 1 with its active optic sectors 500 , 510 , 520 , 530 , 540 , 550 , 560 , 570 , 580 ,
  • any active optic segment e.g. , segments 502 , 504 , 506 , 508 , in vertical sector 500 , can be addressed via respective electric traces, e.g.
  • sector 500 traces 503 , 505 , 507 , 509 for sector 500 , so that the detector array 82 can detect light energy distribution and intensity (I) in the Fourier transform optic pattern 32 at any angular orientation (R) of a sector 500 , 510 , 520 , 530 , 540 , 550 , 560 , 570 , 580 , 590 , 600 , 610 , 620 , 630 , 640 , 650 and at selected radial distances from the optic axis 40 .
  • sector 500 is oriented substantially vertical in relation to the optic axis 40 .
  • any one or more sectors 500 , 510 , 520 , 530 , 540 , 550 , 560 , 570 , 580 , 590 , 600 , 610 , 620 , 630 , 640 , 650 can be selected and activated sequentially, simultaneously, or in various combinations, depending on the detail or particular light energy distributions in the FT optic pattern 32 it is desired to detect.
  • the preferred, but not essential, shape of the active optic sectors, e.g. , sector 500 , in the segmented radial SLM 50 is a narrow, elongated wedge.
  • the width of the wedge will depend on the light energy available or needed and the optic resolution desired. A wider sector will direct more light energy 34 to the detector 80 , but precision of line or feature resolution of the image 12 ′ will degrade slightly. A narrower sector will get better line resolution, but with a corresponding increase in the complexity of the resulting pattern shape generalization and complexity and a decrease in light energy directed to the detector 80 .
  • sectors of different shapes (not shown), such as ovals, or other shapes could be used to capture shapes other than lines from the image 12 .
  • the number of active optic segments in a sector e.g. , the four segments 502 , 504 , 506 , 508 sector 500 , also has similar constraints. Smaller segments direct less light energy to the detector 80 , but may provide more resolution of shape characteristics of the image 12 ′, whereas larger segments direct more light to the detector 80 , thus are more easily detectable, but resolution decreases.
  • the same lower resolution effect can be achieved in the illustrated embodiment 50 in FIGS. 1 - 3 by activating all the segments 502 , 504 , 506 , 508 in a sector simultaneously, as described above.
  • each sector e.g. , sector 500
  • each sector comprises four individually addressable, active optic segments, e.g. , segments 502 , 504 , 506 , 508 , as shown in FIG. 3, although any number of segments other than four can also be used according to this invention.
  • the length of each successive radial outward segment is twice as long as the next adjacent radially inward segment.
  • the near inner segment 504 is about twice as long as the inner segment 502 .
  • the near outer segment 506 is about twice as long as the near inner segment 504
  • the outer segment 508 is about twice as long as the near outer segment 506 .
  • the radial length of inner segment 502 is L
  • the radial length of near inner segment 504 is 2L
  • the radial length of the near outer segment 506 is 4L
  • the radial length of the outer segment 508 is 8L.
  • the distance d between the optic axis 40 and the inner edge 501 of inner segment 502 is about the same as the length L of inner segment 502 , so the diameter of the center area 57 is about 2L.
  • the near inner segments (e.g., 504 ) to capture shape features of the image 12 ′ that have sizes in a range of about 12 ⁇ fraction (1/2) ⁇ - 25 percent of the size of image 12 ′ the near outer segments (e.g. , 506 ) to capture shape features of the image 12 ′ that have sizes in a range of about 61 ⁇ 4-121 ⁇ 2 percent of the size of image 12
  • any features of the image 12 ′ that have sizes over 50 percent of the size of image 12 ′, which light energy is incident on the center area portion 41 can either be captured and detected as an indicator of general brightness of the image 12 ′ for intensity control or calibration purposes or just ignored and not captured or detected at all, because there is little, if any, useable shape information or content in the light energy that comprises that 50 percent of the size of the image 12 ′.
  • the approximately 31 ⁇ 8 percent of the size content of the image 12 ′ that is radially outward beyond the outer segments is not detected and can be ignored in this preferred configuration.
  • the light in the center 41 can be made optically active to capture light energy incident thereon, if it is desired to capture and detect such light energy for general brightness indication, intensity control, or calibration purposes, as will be understood and within the capabilities of persons skilled in the art, once they understand this invention.
  • Other configurations of the segmented radial SLM 50 could also be made and used within the scope of this invention.
  • FIGS. 1 - 3 and 5 illustrate how selection and activation of any particular active optic segment, for example, near outer segment 506 and outer segment 508 , function to selectively enable detection of light energy from the Fourier transform optic pattern 32 that is incident on such segments.
  • the optic active segments 506 , 508 which are typical of other active optic segments, are part of an integrated circuit 52 , which is mounted on a chip base or platform 56 .
  • the integrated circuit 52 has a variable birefringent material 180 , such as a liquid crystal material, sandwiched between two transparent substrates 182 , 184 , such as high quality glass.
  • the variable birefringent material 180 is responsive to a voltage to change its birefringence in the area of the voltage, which results in rotation of the plane of polarization of the light that passes through the material 180 .
  • the division between near outer segment 506 and outer segment 508 is made by a separation of respective metal layers 186 , 188 .
  • An intervening dielectric or electrical insulation material 185 can be used to maintain electrical separation of these metal layers 186 , 188 .
  • electrically conductive trace 507 is connected to the metal layer 186 of near outer segment 506
  • trace 509 is connected to the metal layer 188 of outer segment 508 .
  • the electric traces 507 , 509 and metal layers 186 , 188 can be deposited the same metal and can be on the back substrate 184 concurrently with their respective metal layers 186 , 188 during fabrication of the integrated circuit 52 , as would be understood and within the capabilities of persons skilled in the art of designing and fabricating spatial light modulators, once they are informed of the principles of this invention. Therefore, the metal layers 186 , 188 can be addressed individually through their respective connected traces 507 , 509 by connecting positive (+) or negative ( ⁇ ) voltages V 1 and V 2 , respectively, to traces 507 , 509 .
  • a transparent conductive layer 190 deposited on the front substrate 182 is connected by another lead 513 to another voltage V 3 . Therefore, a voltage can be applied across the portion of the liquid crystal material 180 that is sandwiched between the metal layer 186 and the transparent conductive layer 190 by, for example, making V 1 positive and V 3 negative and vice versa. Likewise, when a voltage can be applied across the portion of the liquid crystal material 180 that is sandwiched between the metal layer 188 and the transparent conductive layer 190 by, for example, making V 2 positive and V 3 negative and vice versa.
  • the function of the respective segments 506 , 508 is to rotate the plane of polarization of selective portions of the incident light beam 27 ( p ) so that those portions of the light beam 27 ( p ), which carry corresponding portions of the Fourier transform optic pattern 32 , can be separated and isolated from the remainder of the light beam 27 ( p ) for detection by the photodetector array 82 (FIG. 5).
  • the photodetector array 82 FIG. 5
  • the segmented radially spatial light modulator illustrated in FIG. 4 can have respective alignment layers 192 , 194 deposited on the transparent conductive layer 190 on substrate 182 and on the metal layers 186 , 188 on substrate 184 .
  • These alignment layers 192 , 194 are brushed or polished in a direction desired for boundary layer crystal alignment, depending on the type of liquid crystal material 180 used, as is well-understood in the art. See, e.g., J. Goodman, “Introduction to Fourier Optics, 2 nd ed. , chapter 7 (The McGraw Hill Companies, Inc.) 1996.
  • An antireflective layer 196 can be deposited on the outside surface of the glass substrate 182 to maintain optical transmissive efficiency.
  • One example system can use a liquid crystal material 180 that transmits light 27 ( p ) without affecting polarization when there is a sufficient voltage across the liquid crystal material 180 and to act as a 1 ⁇ 4-wave retarder when there is no voltage across the liquid crystal material.
  • An untwisted crystal material 180 that is birefringent in its untwisted state can function in this manner.
  • the liquid crystal material in outer segment 508 when no voltage is applied across the liquid crystal material 180 in segment 508 , there is no molecular rotation of the liquid crystal material 180 in outer segment 508 , and the liquid crystal material in outer segment 108 , with the proper thickness according to the liquid crystal manufacturer's specifications, will function as a 1 ⁇ 4-wave plate to convert p-polarized light 27 ( p ) incident on outer segment 508 to circular polarization as the light passes through the untwisted liquid crystal material 180 .
  • the metal layer 188 which is reflective
  • the light is reflected and passes back through the liquid crystal material to undergo another 1 ⁇ 4-wave retardation to convert the circular polarization to linear polarization, but in the s-plane, which is orthogonal to the p-plane.
  • the reflected light 61 ( s ) therefore, has its plane of polarization effectively rotated by 90 degrees in relation to the incident light 27 ( p ).
  • a twisted liquid crystal material 180 may be used to rotate plane of polarization under a voltage and to not affect plane of polarization when there is no voltage.
  • the computer 20 can be programmed to provide signals via link 198 to the segmented radial SLM 50 to select and coordinate activation of particular segments, for example, segments 502 , 504 , 506 , 508 , with displays of particular images 12 , 14 , . . , n.
  • the computer 20 can also be programmed to coordinate laser source 23 via a link 29 to produce the required light energy 24 , when the selected segment of the segmented radial SLM 50 is activated.
  • the reflected light 61 ( s ) from the segmented radial SLM 50 e.g. , light polarized in the s-plane reflected from an activated segment, as explained above, does not pass back through the polarizing beam splitter 70 along with p-polarized reflected light. Instead, the s-polarized reflected light 61 ( s ) is reflected by the plane 72 in the polarizing beam splitter 70 to the detector 80 .
  • the lens 78 magnifies and focuses the isolated beam 61 ( s ) in a desired size on the detector array 82 of photodetector 80 .
  • the photodetector array 82 can be a 16 ⁇ 16 array of individual light sensors 84 , such as charge coupled devices (CCDs), as shown in FIG. 5, or any of a variety of other sizes and configurations.
  • the x, y coordinates of individual sensors 84 in the array 82 that detect light 61 ( s ) can be communicated, along with light intensity (I) information, to the computer 20 or other controller or recording device via a link 86 , where it can be associated with information bout the image 12 , 14 , . . . , n and the angular orientation and/or radial position of the activated segment( s ) in the segmented radial SLM 50 that provided the beam 61 ( s ) to the detector 80 .
  • I light intensity
  • FIG. 6 a the active optic area 54 from FIGS. 1 and 2 is shown in FIG.
  • the sectors can be any desired width or any desired angular orientation, but a convenient, efficient, and effective configuration is to provide sectors of 11.25°. For example, a circle of 360° divides into 32 sectors of 11.25° each, and a semicircle of 180° divides into sixteen sectors of 11.25° each.
  • the light energy distribution in any semicircle of a Fourier transform optic pattern 32 is symmetric with its opposite semicircle. Therefore, detection of the light energy pattern in one semicircle of the FT optic pattern 32 , for example, in the semicircle extending from 0° to 180°, provides effective information for the entire image 12 ′, and detection of the light energy pattern in the opposite semicircle extending from 180° to 360° provides the same information. Consequently, to alleviate clutter and better accommodate the electric traces (shown in FIGS. 1 - 3 , some of sectors can be positioned in one semi-circle of the optic area 54 with intervening spaces to accommodate the electric traces (shown in FIGS.
  • All 16 of such optically active sectors could be positioned in one semicircle of the area 54 , or, as explained above, it is more convenient and less cluttered to position some of the optically active sectors in one semicircle with intervening spaces and others in the opposite semicircle diametrically opposite to the intervening spaces.
  • any eight of the sectors e.g.
  • sectors 640 , 650 , 500 , 510 , 520 , 530 , 540 , 550 , separated by non-active areas 641 , 651 , 501 , 511 , 521 , 531 , 541 , are positioned in one semicircle of the area 54 , while the remaining eight of the sectors 560 , 570 , 580 , 590 , 600 , 610 , 620 , 630 , also separated by non-active areas 561 , 571 , 581 , 591 , 601 , 611 , 621 , can be positioned in the opposite semicircle, as shown in FIG. 6 a .
  • each of the 16 active optic sectors 500 , 510 , 520 , 530 , 540 , 550 , 560 , 570 , 580 , 590 , 600 , 610 , 620 , 630 , 640 , 650 in this arrangement is positioned diametrically opposite a non-active area, the symmetry of the FT optic pattern 32 (FIG. 5) effectively allows all of the light energy distribution in FT optic pattern 32 to be directed with these sectors.
  • This principle also facilitates design and fabrication of an effective segmented radial SLM 50 , because, for every active optic sector, there can be an adjacent inactive sector or area available for placement of electrically conductive traces to the segments, as shown by reference back to FIGS. 2 and 3.
  • the inactive area 651 between active optic segments 500 and 650 accommodates placement of traces 503 , 505 , and 507 (shown in FIG. 3) to respective segments 502 , 504 , 506 of active optic sector 500 .
  • the above-described symmetry principle is applied by providing an active optic sector 590 in a position diametrically opposite the said non-active area 501 . Therefore, detection of light energy detected in the active optic sector 590 is effectively detecting light energy incident on the non-active area 501 between sectors 500 , 510 .
  • two of the active optic sectors e.g. , sectors 550 , 560 are positioned adjacent each other without any significant intervening non-active area, so the diametrically opposite non-active area 631 is twice as big as other non-active areas.
  • substantially all light energy 34 of FT optic pattern 32 is detectable by the sixteen 11.25° active optic sectors 500 , 510 , 520 , 530 , 540 , 550 , 560 , 570 , 580 , 590 , 600 , 610 , 620 , 630 , 640 , 650 .
  • each active optic sector 500 , 510 , 520 , 530 , 540 , 550 , 560 , 570 , 580 , 590 , 600 , 610 , 620 , 630 , 640 , 650 is about 11.25°.
  • Active optic sectors from sector 640 clockwise to sector 550 are each separated by respective non-active areas 641 , 651 , 501 , 511 , 521 , 531 , 541 of 11.25°.
  • each active optic sector from sector 560 clockwise to sector 630 is positioned diametrically opposite a respective non-active area 561 , 571 , 581 , 591 , 601 , 611 , 621 . Therefore, to detect all the light energy distribution in the FT optic pattern 32 (FIG. 4) incident on the active area 54 can be detected in 11.25° intervals by the 11.25° sectors 500 , 510 , 520 , 503 , 504 , 550 , 560 , 570 , 580 , 590 , 600 , 610 , 620 , 630 , 640 , 650 positioned as described above.
  • light energy characteristic of that incident on both the vertical 11.25° sector 500 centered at 0° as well as on the non-active area 581 centered at 180° can be detected by effectively activating the active optical segments 502 , 504 , 506 , 508 of sector 500 .
  • Light energy characteristic of that incident on the 11.25° sector 590 centered at 191.25° as well as on the non-active area 501 centered at 11.25° can be detected effectively by activating the active optic segments of sector 590 , because the active optic sector 590 is centered diametrically opposite the non-active area of 11.25°.
  • Light energy characteristic of that incident on either the 11.25° sector 510 centered at 22.5° or the non-active area 591 centered at 202.5° can be detected by activating the active optic segments of sector 510 .
  • Light energy characteristic of that incident on either the 11.25° non-active area centered at 33.75° or active sector 600 centered at 213.75° can be detected by activating the active optic segments of sector 600 , which is centered diametrically opposite 33.75° at 213.75°.
  • Light energy characteristic of that incident on either the 11.25° sector 520 centered at 45° or non-active area 601 centered at 225° can be detected by activating the active optic segments of sector 520 .
  • Light energy characteristic of that incident on either the 11.25° non-active area 521 centered at 56.25° or the active sector 610 centered at 236.25° can be detected by activating the active optic segments of sector 610 , which is centered diametrically opposite 56.25° at 256.25°.
  • Light energy characteristic of that incident on either the 11.25° sector 530 centered at 67.5° or the non-active area 611 centered at 247.5° can be detected by activating the active optic segments of sector 530 .
  • Light energy characteristic of that incident on either the 11.25° non-active area 531 centered at 78.75° or active sector 620 centered at 258.75° can be detected by activating the active optic segments of sector 620 , which is centered diametrically opposite 78.75° at 258.75°.
  • Light energy characteristic of that incident on either the 11.25° sector 540 centered at 90° or non-active area 621 centered at 270° can be detected by activating the active optic segments of sector 540 .
  • Light energy characteristic of that incident on either the 11.25° non-active area 541 centered at 101.25° or the active sector 630 centered at 281.25° can be detected by activating the active optic segments of sector 630 , which is centered diametrically opposite 101.25° at 281.25°.
  • Light energy characteristic of that incident on either the 11.25° sector 550 centered at 112.5° the diametrically opposite portion of non-active area 631 that is centered at 292.5° can be detected by activating the active optic segments of sector 550 .
  • the diametrically opposite portion of non-active area 631 that is centered at 303.75° can be detected by activating the active optic segments of sector 560 .
  • Light energy characteristic of that incident on the 11.25° non-active area 561 centered at 135° or active sector 640 centered at 315° can be detected by activating the active optic segments of sector 640 , which is centered diametrically opposite 135° at 315°.
  • Light energy characteristic of that incident on the 11.25° sector 570 centered at 146.25° or non-active area 641 centered at 326.25° can be detected by activating the active optic segments of sector 570 .
  • FIG. 6 a illustrates activation of the outer segment 508 of the active optic sector 500 by depicting bands of light energy 34 from the FT optic pattern 32 that are incident on and reflected by the outer segment 508 .
  • These bands of light energy 34 which are dispersed fartherest radially outward in the vertical direction in the FT optic pattern 32 , emanated originally from, and correspond to, substantially vertically oriented lines, edges, features, or details in the image 12 ′ that have a higher spatial frequency, such as the substantially vertical lines of the bumper and grill parts 35 in FIG. 6 b .
  • the light energy 34 from the more intricate or closely spaced vertical parts or lines 66 are dispersed farther radially outward from the optical center or axis 40 , thus detectable by activating outer segments 506 , 508 of vertical sector 500 , while the light energy 34 from the less intricate, more isolated and semi-isolated or farther spaced apart vertical parts, edges, or lines (i.e., lower spatial frequency), such as the substantially vertical parts or lines 66 ′ in the trunk and rear bumper portions of the image 12 ′ in FIG.
  • the intensity of the light energy 34 in those respective dispersion bands depends on the brightness of the corresponding respective vertical features 35 , 66 , 66 ′ in the image 12 ′.
  • the central portion 41 of the active optic area 54 can be ignored, if desired, because the light energy 54 in and near the center or axis 40 of the Fourier transform 32 (FIG. 5) emanates from features in image 12 ′ with very low or virtually no spatial frequencies, such as the overall brightness of the image, which do very little, if anything, to define shapes.
  • the center portion 41 can be fabricated as an active optic component to capture and reflect the light energy incident on the center portion 41 to the detector 80 as a measure of overall brightness, which may be useful in calibrating, adjusting brightness of the source light 25 ( s ) (FIG. 5), calibrating intensity (I) measurements of sensors 84 in detector 80 , and the like.
  • the light energy bands 34 when reflected by the activated outer segment 508 , are filtered through the polarizing beam splitter 70 and projected in the filtered optic pattern 60 , which is comprised primary of vertical lines or bands 62 of light energy illustrated diagrammatically in FIG. 6 c , to the photodetector 80 (FIG. 5).
  • the light energy in the filtered optic pattern 60 is detected by the light sensors 84 in detector array 82 .
  • the intensity (I) of light energy on each sensor 84 is recorded along with the sensor (pixel) location, preferably by x-y coordinates, and the angular orientation (R) of the sector 500 .
  • the radial position or scale (S) of the activated segment 508 is also recorded, for example, as RIXSe1 values described above. These values can be stored in a database 102 in association with information about the characterized image 12 , such as image identification (ID), source location (URL, database address, etc.) of the image 12 , digital format, resolution, colors, texture, shape, subject matter category, and the like.
  • ID image identification
  • URL source location
  • database address etc.
  • the near inner segment 504 of active optic sector 500 is shown in FIG. 7 a as being selected to rotate plane of polarization of selected portions of the light energy bands 34 from the FT optic pattern 32 for isolation by the polarizing beam splitter 70 and then detection by the photodetector 80 .
  • This near inner segment 504 is also in the vertically oriented sector 500 , but it is positioned or scaled radially closer to the optic axis 40 than the outer segment 508 , which was activated in the previous example. Therefore, this near inner segment 504 , when activated, captures light energy 34 in the FT optic pattern 32 that also corresponds to vertical lines, edges, etc. , of the image 12 ′, but to such lines, edges, etc.
  • the light energy 34 from the FT optic pattern 32 selected by the near inner segment 504 may be more characteristic of the more spatially semi-isolated vertical edge 66 ′ of the trunk lid and other vertical lines and edges 66 of similar semi-isolation in the automobile image 12 ′ in FIG. 6 b . Therefore, the light energy bands 62 in the resulting filtered beam 61 ( s ), as shown in optic pattern 60 in FIG. 8 c , are characteristic of such vertical shape content 66 , 66 ′ in the image 12 ′.
  • FIGS. 8 a - c Another example angular orientation of light energy 34 from the FT optic pattern 32 is illustrated by FIGS. 8 a - c .
  • the near outer segment 526 in this example is activated to capture light from lines, edges, or features extending radially at an angular orientation of 45° from vertical.
  • Such light energy 34 is characteristic of lines, edges, or features in the image 12 ′ that extend at about 45° and that have some spatial frequency, i.e., are not isolated, such as, perhaps, the window post and roof support 67 in FIG. 8 b .
  • the reflected and filtered beam 61 ( s ) with the optical pattern 60 for these 45° angular oriented shape contents have bands 62 of the light energy oriented at about 45°, as illustrated diagrammatically in FIG. 8 c .
  • Such light energy bands 62 are detected by sensors 84 for photodetector 80 (FIG. 5) and are recorded and stored as characteristic of the spatial frequency of 45°-oriented shape content of the image 12 ′.
  • Capture and detection of horizontal portions of lines, edges, and features 68 , 68 ′ of the image 12 ′ is accomplished by activation of one or more segments 542 , 544 , 546 , 548 of Horizontal sector 540 , which is oriented 90° from the vertical 0°.
  • the portion of the light energy 34 that is reflected by any activated segment 542 , 544 , 546 , 548 of the horizontal sector 540 is characteristic of all of the substantially horizontal features, parts, and lines 68 of the image 12 ′, as shown in FIG. 9 b .
  • Some curved features, parts, or lines in the image 12 ′ have portions or line segments 68 ′ that are also substantially horizontal, so those horizontal portions or line segments 68 ′ also contribute to the light energy 34 that gets reflected by the horizontal sector 540 in FIG. 9 a .
  • the bands 62 of light energy in the filtered pattern 60 shown in FIG. 9 c , resulting from the horizontal orientation of an activated segment 542 , 544 , 546 , 548 in FIG. 9 a , are also oriented substantially horizontal and are indicative of some or all of the shape characteristics 68 , 68 ′ of image 12 ′ that are oriented substantially horizontal.
  • the inner segments 542 , 544 are activated to detect light energy bands 34 from the FT optic pattern 32 that are dispersed closer to the optic axis 40 , thus are characteristic of lower spatial frequency, horizontal shape content of the image 12 ′, while higher spatial frequency, horizontal shape content can be detected by activating the outer segments 546 , 548 of the horizontal sector 540 .
  • detection of the light energy bands 62 in FIG. 9 c by detector array 82 (FIG. 5) facilitates encoding and recording of the horizontal shape characteristics of the image 12 ′, as was described above.
  • FIG. 10 a One more example activated segment 598 in sector 590 , is illustrated in FIG. 10 a to describe the symmetric light energy detection feature described above.
  • the light energy bands 34 of the FT optic pattern 32 that are incident on the non-active area between the active optic sectors 500 , 510 are symmetric with the diametrically opposite light energy bands 34 , which are incident on the active optic segments 529 , 594 , 569 , 598 in sector 590 . Therefore, activation of a segment, for example, outer segment 598 , as illustrated in FIG. 10 a , will enable effective detection of the diametrically opposite, equivalent light energy 34 that is incident between the segments 508 , 518 of respective sectors 500 , 510 .
  • any other segment 592 , 594 , 596 enables effective detection of other diametrically opposite portions of light energy that is incident in the non-active area 501 between active sectors 500 and 510 . Therefore, detecting light energy 34 incident on the sector 590 , which is centered at 191.25° in the example of FIG. 10 a , is the equivalent of detecting light energy 34 that is incident on the non-active area 501 centered at 11.25°. The opposite also holds, i.e., detection of light energy 34 incident on the vertical sector 500 , as illustrated in FIGS. 6 a and 7 a and described above, is the equivalent to detecting light energy from the FT optic pattern 32 that is incident on the non-active area 581 between active sectors 580 and 590 .
  • the light energy 34 detected in the sector 590 corresponds to shape content 69 , such as lines, edges, portions of curves, and the like in the image 12 ′ that are oriented substantially at about 191.25°, which, being linear, can also be expressed as oriented at about 11.25°.
  • the light energy bands 62 in the reflected and filtered optic pattern 60 also have that same angular orientation, which is characteristic of the linear shape content of the image 12 ′ that has that angular orientation and that has higher spatial frequency if reflected by outer segments 596 , 598 or lower spatial frequency if reflected by inner segments 592 , 594 .
  • the optic patterns 60 resulting from such various reflected portions of the FT optic pattern 32 are detected by the sensors 84 in detector array 82 for recording and storage, as described above.
  • any particular angular orientation R of segments of sectors in the active optic area 54 will allow detection of all the shape characteristics of image 12 ′ that have substantially that same angular orientation R.
  • radial outward spacing or scale (S) of the segments relates to spatial frequency of such shape characteristics.
  • all of the shape characteristics of the image 12 ′ can be detected by detecting the bands 62 of the respective filtered patterns 60 with the segments at all angular orientations.
  • the smaller the increments of angular orientation the more data that will have to be processed. Therefore, when selecting the angular increments of sectors at which light energy bands 34 will be detected and recorded, it may be desirable to strike some balance between preciseness of shape characteristics needed or wanted and the speed and efficiency of data processing and storage required to handle such preciseness. For example, but not for limitation, it is believed that detection and recording of the shape characteristics at angular increments of in a range of about 5 to 20 degrees, preferably about 11.25-degrees, will be adequate for most purposes. Also, the angular area of detection can be varied.
  • the active optic areas could be narrow, such as in a range of 3° to 8°, more or less, which would filter out some of the optic energy from the FT optic pattern 32 between the sectors.
  • loss of light energy from non-active areas between sectors or other radially extending sensors, as described elsewhere in this specification may not be detrimental shape characterization by this invention, depending on specific applications of the technology to particular problems or goals.
  • an alternate configuration can be comprised of radially extending, rectangular-shaped active optic modulators as illustrated diagrammatically in FIG. 1.
  • These rectangular-shaped modulators 500 ′, 510 ′, 520 ′, 530 ′, 540 ′, 550 ′, 560 ′, 570 ′, 580 ′, 590 ′, 600 ′, 610 ′, 620 ′, 630 ′, 640 ′, 650 ′ can be at the same or different angular orientations as the wedge-shaped sectors described above, and each angular orientation can comprise several rectangular, active optic segments, such as segments 502 ′, 504 ′, 506 ′, 508 ′ of the modulator 500 ′.
  • This arrangement does not capture as much of the light energy of an incident FT optic pattern 32 (FIG. 5) as the wedge-shaped segments and sectors described above, but shape resolution may be greater.
  • FIG. 12 Another, albeit less efficient embodiment, is illustrated in FIG. 12, where the desired sectors and segments, which are shown in phantom lines, can be formed by activating selected groups of light modulator elements 702 in a pixel array 700 type of spatial light modulator simultaneously.
  • a virtual outer segment 508 ′′ of a vertical sector 500 ′′ can be activated by activating simultaneously a segment group 508 ′′ of the light modulator pixel elements 602 . While there are versatility advantages to this type of implementation, such advantages may be outweighed by the complexity and cost as compared to the simpler configurations described above.
  • an alternative transmissive spatial light modulator structure 50 ′ illustrated in FIG. 13 could also be used with each of the configurations.
  • the metal reflective layers 186 , 188 are replaced by transparent conducting layers 186 ′, 188 ′, such as indium tin oxide (ITO) or any of a number of other well-known transparent conducting materials.
  • ITO indium tin oxide
  • incident 27 ( p ) may or may not have its plane of polarization rotated, depending on whether a voltage V+ is applied to either layer 186 ′ or 188 ′, but, instead of being reflected, the light is transmitted through the device 50 ′ to emerge as light energy 61 ( s ) or 61 ( p ), as indicated in FIG. 13.
  • this device is mounted around its periphery in a base 56 , so the base 56 does not interfere with the light 61 ( s ) and 61 ( p ) propagation.
  • a different liquid crystal material 180 ′ and/or a different thickness of liquid crystal material than the liquid crystal material 180 for the FIG. 4 embodiment would be required, since the light passes only once through the liquid crystal material 180 ′.
  • the accuracy, versatility, and efficiency of shape characterizing, processing, storing, searching, comparing, and matching images according to this invention can be enhanced by some pre-processing of the images 12 , 14 , . . . , n when creating the optical patterns for the images 12 ′, 14 ′, . . . , n′ at the SLM 26 in FIG. 5.
  • One particularly beneficial method of such pre-processing is “ghosting” the image to allow more light energy into the optic pattern 12 ′, thus also allowing more light energy into the FT optic pattern 32 .
  • FIGS. 14 a - c the ghosting process of this invention is illustrated first with an image content of a simple dot, such as a typed period 600 , which is illustrated as greatly enlarged in FIG. 14 a .
  • the computer 20 FIG. 5
  • Myriad edge-finding software programs are available commercially to perform such edge-finding tasks, such as Labview IMAQTM available from National Instrument Corporation, of 11500 Mopac Expressway, Austin, Tex. More complex images 12 , 14 , . . . , n would, of course, have more edge content.
  • Elimination of non-edge content of the images 12 , 14 , . . . , n does not degrade the shape characterizing function or performance of this invention, because the edges define the shape characteristics and produce the detectable FT optic patterns 32 .
  • plain, uniform, unchanging portions of images such as the side panel 36 of the automobile in image 12 ′ or the clear blue sky in a landscape picture 14 do not contribute significant detectable shape content to such images.
  • light energy from such plain, uniform, unchanging portions of images tends to focus on or very near the optic axis 40 in Fourier transform optic patterns 32 , thus would be incident primarily on the center section 41 of the segmented radial SLM 50 (see FIG. 2) and is either not detected at all or detected only to determine background brightness of the image, as explained above.
  • the image 600 is converted to an optic pattern of the edge content 602 of the image 600 , as illustrated in FIG. 14 b , it is ghosted by creating a plurality of ghost images 602 the edge content 602 .
  • a plurality of ghost images 602 A , 602 B 602 C are created and added to the optic pattern of the edge image 602 .
  • a first set of eight ghost images 602 A is added a first radial distance r 1 outward from the original edge image 602 at 45° angular increments.
  • a second set of eight more ghost images 602 B are added another radial distance r 2 outward from the ghost images 602 A and at 45° angular increments, and a third set of eight ghost images 602 C are added another radial distance r 3 outward and at 45° increments.
  • Each of the ghost images 602 A , 602 B , 602 C have the same shape and are of the same size as the original edge image 602 . Therefore, while there is more light energy and more spatial frequency in the ghosted image 602 ′ of FIG. 14 c than in the edge image 602 of FIG. 14 b, there is no new shape content. Consequently, there will be both a wider radial dispersement and increased intensity of light energy 34 in the FT optic pattern 32 (FIG. 5), which can be detected with the segmented radial SLM 50 and detector 80 . the higher intensity light energy makes it easier for the sensors 84 in detector 80 to detect the light energy diverted by the segmented radial SLM 50 to the detector 80
  • the initial edge image pattern 602 is bright, the nearest ring of ghost edge images 602 A is less bright, the next ring of ghost edge images 602 B is even less bright, and the outermost ring of ghost edge images 602 C is less bright yet.
  • the ghost images 602 A , 602 B , 602 C increase the spatial frequency of the image 602 ′, thus cause more radial dispersion of the light energy bands 34 in the FT optic pattern 32 , so the portions of the light energy bands 34 that originate from the initial edge image 602 in the center of the ghosted pattern 602 ′ are brighter, i.e., more intense, than portions of the light energy bands 34 that originate from the ghost images 602 A , 602 B , 602 C .
  • the sensors 84 that sense the highest intensity (I) light energy will be the sensors 84 that correspond to the initial edge image 602 , and those intensities can be recorded and stored for future access, analysis, searching, matching, and/or retrieving, as described above.
  • the lesser intensities detected by other sensors 84 for light energy emanating from the nearest ring of ghost images 602 A are also recorded and stored, as are those even lesser light intensities emanating from the other rings of ghost images 602 B , 602 C sensed by still other sensors 84 .
  • matches to the brightest or highest intensities of both images would indicate the highest probability that the respective images are the same. If no such match can be found to the brightest or highest intensity pixels, RIXels, or other records of optic patterns that are characterized as described above, then comparisons to lesser intensities corresponding to ghost images 602 A , 602 B , 603 C can be attempted to find near matches.
  • the ghosting process is quite simple and can be scaled to achieve a desired result. Essentially, a software program can simply be applied to reproduce each pixel of an image at selected locations at selected distances and at selected angular orientations in relation to such pixel, as illustrated in the simple example of the dot 600 in FIGS. 14 a - c .
  • An example of this ghosting process in a slightly more complex image 610 in the shape of a house is illustrated in FIGS. 15 a - c .
  • the edges of the uniform or featureless areas of the house image 610 are found and produced in an edge image 612 ,, which maintains the shape content of the image 610 , as explained above.
  • the ghosting process described above is applied to the edge image 612 , as illustrated in FIG. 14 c , to create ghost images 612 A , 612 B , 612 C at selected distances, angular orientations, and decreasing brightnesses the farther the ghost images 612 A , 612 B , 612 C are from the initial edge image 612 .
  • the ghosting process of this invention can also be applied to images for which edges have not been found or produced, as described above. However, more pixel processing by the computer 20 or other processor would be required, and resulting shape resolution may not be as sharp.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Nonlinear Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Library & Information Science (AREA)
  • Optics & Photonics (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Geometry (AREA)
  • Chemical & Material Sciences (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Input (AREA)
  • Holo Graphy (AREA)
US10/051,364 1999-06-04 2002-01-18 Apparatus and method for radial and angular or rotational analysis of images for shape content and matching Abandoned US20020122595A1 (en)

Priority Applications (13)

Application Number Priority Date Filing Date Title
US10/051,364 US20020122595A1 (en) 1999-06-04 2002-01-18 Apparatus and method for radial and angular or rotational analysis of images for shape content and matching
KR1020047011091A KR100971808B1 (ko) 2002-01-18 2003-01-16 형상 콘텐츠에 의한 화상의 방사상 및 각도상 또는 회전상분석 및 매칭 장치 및 방법
JP2003562708A JP5244283B2 (ja) 2002-01-18 2003-01-16 画像の形状内容に関する半径方向および角配向または回転方向解析と照合のための装置および方法
CA2473500A CA2473500C (fr) 2002-01-18 2003-01-16 Appareil et methode permettant l'analyse radiale et angulaire ou rotationnelle de contenu de forme d'image et appariement
RU2004125168/09A RU2300144C2 (ru) 2002-01-18 2003-01-16 Устройство и способ для радиального и углового или с приращением угла анализа изображений применительно к содержанию формы и согласованию
EP03705791A EP1468326A2 (fr) 2002-01-18 2003-01-16 Appareil et procede d'analyse radiale et angulaire ou par rotation d'images pour identifier et apparier des contenus de forme
CNB038064529A CN100354879C (zh) 2002-01-18 2003-01-16 辐射状和角度或旋转分析图像的形状内容和匹配的装置和方法
AU2003207576A AU2003207576B2 (en) 2002-01-18 2003-01-16 Apparatus and method for radial and angular or rotational analysis of images for characterising andfor matching shape content
PCT/US2003/001281 WO2003062907A2 (fr) 2002-01-18 2003-01-16 Appareil et procede d'analyse radiale et angulaire ou par rotation d'images pour identifier et apparier des contenus de forme
US10/385,192 US7103223B2 (en) 2000-03-27 2003-03-10 Apparatus and method for radial and angular or rotational analysis or images for shape content and matching
IL163016A IL163016A (en) 2002-01-18 2004-07-14 Apparatus and method for radial and angular or rotational analysis of images for shape content and matching
US11/470,230 US7302100B2 (en) 2000-03-27 2006-09-05 Method for increasing detectable light energy without changing shape content in radial and angular or rotational analysis of images for shape content and matching
US12/401,461 USRE42070E1 (en) 2000-03-27 2009-03-10 Apparatus and method for radial and angular or rotational analysis of images for shape content and matching

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US09/326,362 US6445822B1 (en) 1999-06-04 1999-06-04 Search method and apparatus for locating digitally stored content, such as visual images, music and sounds, text, or software, in storage devices on a computer network
US09/536,426 US6678411B1 (en) 1999-06-04 2000-03-27 Apparatus and method for characterizing, encoding, storing, and searching images by shape
US10/051,364 US20020122595A1 (en) 1999-06-04 2002-01-18 Apparatus and method for radial and angular or rotational analysis of images for shape content and matching

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/536,426 Continuation-In-Part US6678411B1 (en) 1999-06-04 2000-03-27 Apparatus and method for characterizing, encoding, storing, and searching images by shape

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US10/385,192 Continuation-In-Part US7103223B2 (en) 2000-03-27 2003-03-10 Apparatus and method for radial and angular or rotational analysis or images for shape content and matching

Publications (1)

Publication Number Publication Date
US20020122595A1 true US20020122595A1 (en) 2002-09-05

Family

ID=27609084

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/051,364 Abandoned US20020122595A1 (en) 1999-06-04 2002-01-18 Apparatus and method for radial and angular or rotational analysis of images for shape content and matching
US11/470,230 Expired - Fee Related US7302100B2 (en) 2000-03-27 2006-09-05 Method for increasing detectable light energy without changing shape content in radial and angular or rotational analysis of images for shape content and matching

Family Applications After (1)

Application Number Title Priority Date Filing Date
US11/470,230 Expired - Fee Related US7302100B2 (en) 2000-03-27 2006-09-05 Method for increasing detectable light energy without changing shape content in radial and angular or rotational analysis of images for shape content and matching

Country Status (10)

Country Link
US (2) US20020122595A1 (fr)
EP (1) EP1468326A2 (fr)
JP (1) JP5244283B2 (fr)
KR (1) KR100971808B1 (fr)
CN (1) CN100354879C (fr)
AU (1) AU2003207576B2 (fr)
CA (1) CA2473500C (fr)
IL (1) IL163016A (fr)
RU (1) RU2300144C2 (fr)
WO (1) WO2003062907A2 (fr)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140212052A1 (en) * 2013-01-25 2014-07-31 Delta Electronics, Inc. Method of fast image matching
US9218540B2 (en) 2012-09-18 2015-12-22 Fuji Xerox Co., Ltd. Apparatus and computer readable medium for signal classification using spectrogram and templates
US9983063B1 (en) * 2014-04-15 2018-05-29 Lockheed Martin Corporation Multispectral imaging via coded aperture
WO2018191696A1 (fr) * 2017-04-14 2018-10-18 Arizona Board Of Regents On Behalf Of The University Of Arizona Procédés et appareil utilisant une modulation angulaire et spatiale de lumière
US11223805B2 (en) 2017-04-14 2022-01-11 Arizona Board Of Regents On Behalf Of The University Of Arizona Methods and apparatus for angular and spatial modulation of light
CN115144842A (zh) * 2022-09-02 2022-10-04 深圳阜时科技有限公司 发射模组、光电检测装置、电子设备及三维信息检测方法
US11503255B2 (en) 2017-12-22 2022-11-15 Arizona Board Of Regents On Behalf Of The University Of Arizona Methods and apparatus for angular and spatial modulation of light
US11635614B2 (en) 2017-04-14 2023-04-25 Arizona Board Of Regents On Behalf Of The University Of Arizona Systems and methods for beam steering using a micromirror device

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101196389B (zh) * 2006-12-05 2011-01-05 鸿富锦精密工业（深圳）有限公司 影像量测系统及方法
US7988297B2 (en) * 2007-10-19 2011-08-02 Look Dynamics, Inc. Non-rigidly coupled, overlapping, non-feedback, optical systems for spatial filtering of fourier transform optical patterns and image shape content characterization
CN101719219B (zh) * 2009-11-20 2012-01-04 山东大学 相对弦长关联统计形状特征提取方法
CA3016913C (fr) 2011-06-28 2020-03-10 Samsung Electronics Co., Ltd. Procede de codage video utilisant des reglages de decalage selon la classification des pixels et appareil correspondant, et procede et appareil de decodage video
US10083374B2 (en) 2016-12-12 2018-09-25 Texas Instruments Incorporated Methods and systems for analyzing images in convolutional neural networks
US11410028B2 (en) 2017-09-20 2022-08-09 Look Dynamics, Inc. Photonic neural network system
CN108038824B (zh) * 2017-12-11 2020-07-03 北京大学 一种基于结构光照明的荧光偶极子定向方法

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3771124A (en) * 1972-01-21 1973-11-06 Sperry Rand Corp Coherent optical processor fingerprint identification apparatus
US4462046A (en) * 1982-07-02 1984-07-24 Amaf Industries Incorporated Machine vision system utilizing programmable optical parallel processing
US4923297A (en) * 1986-06-23 1990-05-08 Eyedentify, Inc. Optical alignment system
US4980922A (en) * 1988-05-31 1990-12-25 Grumman Aerospace Corporation System for output plane calibration of an optical correlator
JPH0291607A (ja) * 1988-09-28 1990-03-30 Olympus Optical Co Ltd 液晶絞りを備えた内視鏡光学系
JP2527807B2 (ja) * 1989-05-09 1996-08-28 住友大阪セメント株式会社 光学的連想識別装置
US5177559A (en) * 1991-05-17 1993-01-05 International Business Machines Corporation Dark field imaging defect inspection system for repetitive pattern integrated circuits
US5528702A (en) * 1991-05-31 1996-06-18 Seiko Instruments Inc. Optical pattern recognition apparatus with coordinate conversion function
US5659637A (en) * 1994-05-26 1997-08-19 Optical Corporation Of America Vander lugt optical correlator on a printed circuit board
EP1116169B1 (fr) * 1998-09-24 2003-07-30 QinetiQ Limited Ameliorations apportees a une reconnaissance de formes
JP2001142029A (ja) * 1999-11-12 2001-05-25 Olympus Optical Co Ltd 光情報処理装置
US6678411B1 (en) * 1999-06-04 2004-01-13 Look Dynamics, Inc. Apparatus and method for characterizing, encoding, storing, and searching images by shape
US6445822B1 (en) * 1999-06-04 2002-09-03 Look Dynamics, Inc. Search method and apparatus for locating digitally stored content, such as visual images, music and sounds, text, or software, in storage devices on a computer network
WO2003028213A1 (fr) * 2001-09-28 2003-04-03 Stmicroelectronics Asia Pacific Pte Ltd. Mise en oeuvre d'un banc de filtres non uniformes

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9218540B2 (en) 2012-09-18 2015-12-22 Fuji Xerox Co., Ltd. Apparatus and computer readable medium for signal classification using spectrogram and templates
US20140212052A1 (en) * 2013-01-25 2014-07-31 Delta Electronics, Inc. Method of fast image matching
US9165215B2 (en) * 2013-01-25 2015-10-20 Delta Electronics, Inc. Method of fast image matching
US9983063B1 (en) * 2014-04-15 2018-05-29 Lockheed Martin Corporation Multispectral imaging via coded aperture
WO2018191696A1 (fr) * 2017-04-14 2018-10-18 Arizona Board Of Regents On Behalf Of The University Of Arizona Procédés et appareil utilisant une modulation angulaire et spatiale de lumière
US11223805B2 (en) 2017-04-14 2022-01-11 Arizona Board Of Regents On Behalf Of The University Of Arizona Methods and apparatus for angular and spatial modulation of light
US11635614B2 (en) 2017-04-14 2023-04-25 Arizona Board Of Regents On Behalf Of The University Of Arizona Systems and methods for beam steering using a micromirror device
US11950026B2 (en) * 2017-04-14 2024-04-02 Arizona Board Of Regents On Behalf Of The University Of Arizona Methods and apparatus employing angular and spatial modulation of light
US11503255B2 (en) 2017-12-22 2022-11-15 Arizona Board Of Regents On Behalf Of The University Of Arizona Methods and apparatus for angular and spatial modulation of light
US11509871B2 (en) 2017-12-22 2022-11-22 Arizona Board Of Regents On Behalf Of The University Of Arizona Methods and apparatus for angular and spatial modulation of light
CN115144842A (zh) * 2022-09-02 2022-10-04 深圳阜时科技有限公司 发射模组、光电检测装置、电子设备及三维信息检测方法

Also Published As

Publication number Publication date
KR20040096528A (ko) 2004-11-16
RU2004125168A (ru) 2006-01-27
JP5244283B2 (ja) 2013-07-24
AU2003207576B2 (en) 2009-09-03
JP2006506604A (ja) 2006-02-23
WO2003062907A2 (fr) 2003-07-31
KR100971808B1 (ko) 2010-07-22
EP1468326A2 (fr) 2004-10-20
CN100354879C (zh) 2007-12-12
WO2003062907A3 (fr) 2004-02-19
CA2473500C (fr) 2013-10-15
RU2300144C2 (ru) 2007-05-27
US7302100B2 (en) 2007-11-27
IL163016A (en) 2010-05-31
US20070076280A1 (en) 2007-04-05
CA2473500A1 (fr) 2003-07-31
CN1643539A (zh) 2005-07-20

Similar Documents

Publication Publication Date Title
US7302100B2 (en) Method for increasing detectable light energy without changing shape content in radial and angular or rotational analysis of images for shape content and matching
US7988297B2 (en) Non-rigidly coupled, overlapping, non-feedback, optical systems for spatial filtering of fourier transform optical patterns and image shape content characterization
USRE42070E1 (en) Apparatus and method for radial and angular or rotational analysis of images for shape content and matching
AU2003207576A1 (en) Apparatus and method for radial and angular or rotational analysis of images for characterising andfor matching shape content
US6678411B1 (en) Apparatus and method for characterizing, encoding, storing, and searching images by shape
JP3116055B2 (ja) 光学的パタ−ン識別装置
JPH02293827A (ja) 光学的識別装置
JPH0792176A (ja) 速度測定装置および速度測定方法
JPH03253982A (ja) パターン識別装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: LOOK DYNAMICS, INC., COLORADO

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CRILL, RIKK;REEL/FRAME:012839/0403

Effective date: 20020405

Owner name: LOOK DYNAMICS INC, COLORADO

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CRILL, RIKK;REEL/FRAME:012806/0583

Effective date: 20020405

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION