EP0691064A4 - Low light color imaging system with cooled integrating camera - Google Patents

Low light color imaging system with cooled integrating camera

Info

Publication number
EP0691064A4
EP0691064A4 EP19930917039 EP93917039A EP0691064A4 EP 0691064 A4 EP0691064 A4 EP 0691064A4 EP 19930917039 EP19930917039 EP 19930917039 EP 93917039 A EP93917039 A EP 93917039A EP 0691064 A4 EP0691064 A4 EP 0691064A4
Authority
EP
European Patent Office
Prior art keywords
image
color
imaging
biological sample
colors
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP19930917039
Other languages
German (de)
French (fr)
Other versions
EP0691064A1 (en
Inventor
Jose R Torre-Bueno
Stephen T Degraw
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oncor Inc
Original Assignee
Oncor Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oncor Inc filed Critical Oncor Inc
Publication of EP0691064A4 publication Critical patent/EP0691064A4/en
Publication of EP0691064A1 publication Critical patent/EP0691064A1/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/51Housings
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Optical investigation techniques, e.g. flow cytometry
    • G01N15/1429Signal processing
    • G01N15/1433Signal processing using image recognition
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Optical investigation techniques, e.g. flow cytometry
    • G01N15/1468Optical investigation techniques, e.g. flow cytometry with spatial resolution of the texture or inner structure of the particle
    • G01N2015/1472Optical investigation techniques, e.g. flow cytometry with spatial resolution of the texture or inner structure of the particle with colour
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6428Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • G01N2021/6439Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" with indicators, stains, dyes, tags, labels, marks
    • G01N2021/6441Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" with indicators, stains, dyes, tags, labels, marks with two or more labels

Definitions

  • the invention relates to a color imaging system, and is particularly relevant to the production of a color image using an integrating, low light level, color camera for obtaining multi-color images of biological samples.
  • U.S. Patent 5,008,185 to Bacus describes the use of an imaging system to visually analyze human breast cancer specimen cells which have been marked with an optical enhancement factor using a PAP-staining technique.
  • the quantity of a particular protein in the stained cells is determined from a digital grey scale image of the specimen cells.
  • a significant limitation of grey-scale analysis is that only a single color can be analyzed at a time. If the analysis is to employ more than one- color, each color necessitates a compound step consisting of staining followed by imaging.
  • fluorescent dyes can be carried by known DNA probe techniques into very small structures in human biological specimens. Indeed, fluorescent markers can be carried by probes down to the molecular level of a cell. Ordinary dyes will not stain such small structures. However, because of the small size of fluorescent markers and the nature of their light-generating processes, the image of a specimen stained with fluorescent dyes is very dim.
  • color cameras have been utilized for display and analysis of colored cell images.
  • color cameras have not been employed to acquire colored images of cells stained by fluorescent materials because of the cameras' limited sensitivity and because of the low level of chromatic intensity provided by staining techniques.
  • Proposals have been made to image specimens marked with fluorescent stains using image intensifiers. However, this would result in a monochromatic image and would surrender the significant advantages which a colored image gives.
  • the need exists to provide an imaging system for the display, analysis, and archiving of low light level, color images.
  • the need is particularly acute when the image to be analyzed is a magnified visualization of a cellular specimen.
  • the invention is directed to means and methods for display and analysis of low light level color images for microscopic or macroscopic applications.
  • the objective of the invention is to provide a color camera for acquisition of low light level color images.
  • an imaging system which includes an electronic camera which is capable of low light level color imaging.
  • the camera includes an integrating opto-electronic imaging assembly, a cooling means, and a lens adapter frame.
  • the integrating opto-electronic imaging assembly scans an image and produces image signals representative of intensity distributions of colors in the scanned image.
  • the cooling means is in thermal contact with the imaging assembly and reduces imaging assembly noise in the image signals.
  • the cooling means is mounted in a open end of a camera frame.
  • the lens adapter frame mounts a lens adjacent to the imaging assembly.
  • the lens adapter frame is mounted in thermal contact with the cooling means.
  • the camera has a means acting between the imaging assembly and the lens adapter frame to prevent condensation from forming on the imaging assembly.
  • the electronically cooled integrating camera forms a major component of a system for low light level color imaging.
  • the system includes a means for holding a biological sample, a filtered light source, an integrating electronic color camera, and an image analyzing means.
  • the holding means holds a biological sample which is stained with a plurality of fluorescent dyes.
  • the filtered light source is arranged to illuminate the stained sample.
  • the integrating electronic color camera is arranged to receive light from the biological sample and includes an integrating opto-electric imaging device, a cooling means, and a conversion means.
  • the integrating opto-electronic imaging device scans an image of the sample and produces image signals representative of intensity distributions of colors in the scanned image.
  • the cooling means is positioned in thermal contact with the imaging device for cooling the imaging device and reduces imaging device noise in the signals.
  • the conversion means is connected to the camera and converts the image signals into a plurality of mutually distinct color component signals which correspond to respective colors in the scanned image.
  • the image analyzing means includes a color element means and an image reconstruction means.
  • the color element means which is coupled to receive the color component signals and is responsive to color selection signals identifying at least two colors, produces color identification signals that identify colors among the colors in the scanned image.
  • the image reconstruction means receive the color identification signals and produces a representation of the image in the plurality of colors contained in the image.
  • Figure 1 is an exploded view of a cooled, low light level color camera according to the invention.
  • Figure 2 is an exploded view of a cooled imaging assembly on the camera illustrated in Figure 1.
  • Figure 3 is a magnified, partial side sectional view of the front end of the camera illustrated in Figure 1.
  • Figure 4 is a schematic diagram of a circuit employed in the invention for controlling an electronic cooler in the camera of Figure 1.
  • Figure 5 is a block diagram illustrating a low light level color imaging system including the camera of Figure 1.
  • Figure 6 is a block diagram illustrating in greater detail a multi-color image analyzer included in the system of Figure 5.
  • Utilization of an integrating opto-electronic device improves the sensitivity of the camera by extending image acquisition time in order to collect more photons.
  • integrating opto-electronic devices such as CCD's exhibit a particular noise characteristic in the form of a dark current (i D ) which leaves traces ("artifacts") in an image in the form of pixellation noise which is visualized as a random scattering of color dots across an image which are not produced by any feature of the image but, rather, by the device's response to ambient heat.
  • i D dark current
  • pixellation noise Typically, a magnified visualization of a cell specimen which is magnified through a microscope must be acquired in an integrating color camera over a relatively long integration time. The pixellation noise in the image is proportional to the integration time.
  • the invention is based on the inventors' critical realization that thermal noise effects of an integrating opto-electronic device used in a color camera to acquire low light level cell images colored by fluorescent markers might be reduced significantly by cooling the device during the integrating period. Cooling the device reduces its thermal activity and, consequently, the thermally-induced artifacts in the image acquired by the device.
  • the inventors encountered a significant challenge in devising a means and method for cooling the imaging device which would not interfere with operation of the camera and degrade the quality of the acquired image.
  • the resulting color camera is illustrated in Figures 1, 2, and 3.
  • Figure 1 is an exploded view of a cooled, low light level, integrating color camera to be used in the invention.
  • the camera assembly includes a camera frame 12 with a generally rectangular cross-section, five closed sides, and an open front end 14.
  • a color camera chassis 16 is received and mounted inside the camera frame 12.
  • the camera chassis contains a plurality of circuit boards which contain conventional circuitry thereon, for example, a Pulnix Model TMC-74 with integration connector 12P-02, which receives a signal from a CCD and provides an electronic output (not illustrated) preferably in a form which includes separate RGB components.
  • the invention is not limited to circuitry which produces such signals, and it will be apparent to one having ordinary skill in the art that signals in other formats could serve as well.
  • On the forward end of the camera frame 12 is mounted a cooled imaging assembly 20.
  • the cooled imaging assembly is shown in an exploded view in Figure 2.
  • a standard electronic plug or receptacle 18 is mounted on the forward end of the camera frame 12; the receptacle receives the metallic connectors of a chip carrier 24.
  • An integrating opto-electronic device 28 ("CCD") is mounted in a recess in the chip carrier 24, which is covered by a thin sheet of transparent material (not shown).
  • a single CCD chip is used to record an image.
  • the chip carrier's metallic connectors are conventionally connected to the CCD 28 and are conventionally extended for this invention.
  • a cover assembly 36 includes a bezel 40 which attaches a transparent block 34 over the CCD 28 on the chip carrier 24.
  • a lens adaptor frame 44 is positioned over the imaging device 28.
  • the lens adaptor frame includes a threaded portion 46 for receiving a conventional imaging lens 48 shown in dashed outline.
  • the integrating opto-electronic device 28 is cooled by direct contact with an electronic thermal cooler assembly 30.
  • the electronic cooler assembly 30 can include a Melcor Model Thermoelectric Module Peltier cooler, No. FCO-6-66-05L.
  • the electronic thermal cooler assembly operates conventionally to conduct heat away from the CCD 28 to a heat sink 50.
  • the heat sink 50 includes two parallel, elongate slots 58 through which the pins 26 of the chip carrier 24 extend when they are received in the plug receptacle 18.
  • the electronic thermal cooler assembly 30 is sandwiched between the chip carrier 24 and the heat sink 50.
  • the heat sink 50 is constructed from aluminum or copper and has a substantially rectangular shape which corresponds to the rectangular cross-section of the camera case 12.
  • the heat sink includes a central recess 54 shaped to receive the lens adaptor frame 44 and in which the two slots 58 are disposed.
  • Sets of convection ports 56 are disposed on either side of the recess 54 to enhance cooling of the heat sink by convection.
  • Fans 22 (shown in Figure 1.) are mounted in the camera case 12 adjacent the heat sink in the vicinity of the convection ports 56. The fans operate to increase the flow of air through the convection ports 56 and to increase the rate of cooling of the heat sink 50.
  • Threaded screws are used conventionally to attach the camera chassis 16 to the interior of the camera case 12, the heat sink 50 to the front end 14 of the camera case 12, the fans 22 to the camera case 12, the lens adaptor frame 44 to the heat sink 50 and the bezel 40 to the chip carrier 24.
  • Figure 3 shows a cross-section of the cooled camera of the invention from the heat sink 50 forward to the lens adaptor frame 44. The view is a sectional one, just to the side of the chip carrier 24.
  • cooling of the chip carrier 24 and the CCD 28 can induce condensation on or over the device, which can lead to significant deterioration in the quality of the image produced by the CCD 28 and eventually to failure of the device. Further, since the chip carrier 24 is also being cooled, condensation can form on it and its pins 26 potentially interfering with the operation of the camera.
  • the invention provides for the maintenance of a dry atmosphere for the CCD 28 and the pins 26. The means for maintaining the dry atmosphere are illustrated in Figure 3.
  • the bezel 40 and transparent block 34 when attached to the chip carrier 24 form a space 60 over the CCD 28.
  • This arrangement is normally provided to protect the CCD 28 from contamination and damage.
  • the invention utilizes this arrangement to provide a dry atmosphere for the CCD 28 which is retained in the space 60 by a gasket 32 around the periphery of the bezel 40 between the bezel 40 and the chip carrier 24.
  • the interior space 60 between the transparent block 34 and the CCD 28 contains a dry atmosphere consisting of, for example, dry nitrogen.
  • the dry atmosphere contains no water vapor and, thus, prevents condensation on or over the CCD 28 when it is cooled.
  • the pins 26 are protected in the same manner by provision of a continuous seal 62 contacting and acting between an inner periphery of the lens adaptor frame 44 and an outer periphery of the bezel 40 substantially above the periphery defined by the gasket 32.
  • the seal 62 can be in the form of, for example, an adhesive such as a clear silicone rubber cement.
  • Additional seals 64 composed of an adhesive are provided between the pins 26 and the interior surfaces of the slots 58 of the heat sink 50.
  • the seals 62 and 64 seal a space 66 formed by inner surfaces of the lens adaptor frame 44, the heat sink 50, and the slots 58.
  • the space 66 contains a substantial length of the metallic connectors 26.
  • the space 66 is filled with dry nitrogen, which prevents condensation on the metallic connectors 26 when the chip carrier 24 is cooled by the electronic thermal coolers 30.
  • the lens adaptor frame 44 is mounted in direct thermal contact with the heat sink 50, with the thermal conductivity between the lens adaptor 44 and heat sink 50 being enhanced by, preferably, a silicone grease and very tight contact between these pieces by highly torqued screws. Similarly, a highly conductive thermal path is provided from the chip carrier 24 through the electronic thermal coolers 30 to the heat sink 50 by tight contact and, if necessary, a silicone grease.
  • the camera illustrated Figures 1-3 is preferably assembled in a closed and controlled environment, for example, in a glove box containing an atmosphere of dry nitrogen.
  • a closed and controlled environment By assembling the camera in such a closed and controlled environment, the dry nitrogen is trapped in the spaces 60 and 66 shown in Figure 3 where it is remains even when the camera is removed from the glove box and operated in the manner contemplated by the invention.
  • the cross-sectional representation in Figure 3 shows highly conductive thermal pathways between the CCD 28 and the heat sink 50, and between the heat sink 50 and the lens adaptor frame 44.
  • the electronic thermal cooler assembly 30 When the camera is operated to acquire an image on the CCD 28, the electronic thermal cooler assembly 30 is turned on to conduct heat away from, and thereby cool, the CCD 28.
  • the heat sink 50 conducts the heat laterally to the left and right in Figure 2 toward the sets of convection ports 56. Operation of the fans 22 convects the heat from the heat sink 50.
  • some of the heat conducted from the chip carrier 24 and CCD 28 is returned through the lens adaptor frame 44 and radiated therefrom to the outside surface of the transparent window 38 in the bezel 40. Since this thermal pathway is relatively long, the amount of heat radiated will be relatively low, but will be of a magnitude sufficient to keep the outside of the transparent window 38 above the dew point, thereby preventing condensation on the window 38.
  • a three-CCD chip arrangement is used to record an image.
  • a three-CCD chip arrangement is illustrated in Figure 7.
  • a filter 130 can be placed in front of the CCD chips 132, 134, 136 to split the image into specific color components. The specific color components can then be sent to different CCD chips.
  • a single filter may be used or a three filter configuration can be used to divide the visible color spectrum into three regions.
  • the present invention need not be limited to only the visible portion of the spectrum but may also include electromagnetic radiation in the ultraviolet and infrared portions of the spectrum. The term "light" will be used to include all of these portions of the spectrum.
  • FIG 4 illustrates, in the form of a block diagram, a power circuit for controlling the operation of the cooling elements.
  • a plug 70 receives an AC input which, when switch 72 is closed, is conducted to an AC socket 74 into which a main power supply (not shown) for the camera chassis shown in Figure 1 is plugged.
  • AC power provided to the socket 74 is also provided to a second switch 76 that controls power for fans 22 and the electronic thermal cooling assembly 30 shown in Figures 1-3.
  • the switch 76 When the switch 76 is closed, AC power is provided for conversion by a linear power supply 78.
  • the lamps 75 are power indication lamps.
  • the power supply 106 converts and filters the AC power, providing a +6 volt DC output.
  • the DC output is fed into a plurality of connections 84, 86, and 88 in an output plug 82.
  • the connections can then be used to provide ⁇ » ower to the electronic components of the camera.
  • the connec ⁇ on 84 can provide power to the cooling fans 22 illustrated in Figure 1, while the connection 88 can provide power to the electronic thermal cooler 30 illustrated in Figure 2.
  • a switch 80 when opened, interrupts the power supplied to the fans 22, but does not interrupt the power supplied to the electronic thermal cooler assembly 30.
  • the switch 80 thus eliminates vibration caused by the fans, without interrupting the thermo-electric cooling of the CCD 28 when a very highly magnified image is being acquired.
  • the switch 76 shuts off the active cooling elements of the cooled camera, while permitting the camera chassis electronics to warm up.
  • Figure 5 is a functional block diagram of an image analysis system which employs the cooled low light level color camera described and illustrated above to produce a single, multi-colored electronic image corresponding to a microscopic visualization of a specimen stained with fluorescent dyes.
  • General details of the system of Figure 5 relating to instrument control and mechanization, and specific details of image acquisition and controlling can be understood with reference, for example, to the above-referenced Bacus patent.
  • Figure 5 assumes that a biological specimen on a laboratory slide has been stained by a procedure which selectively marks cell characteristics in the specimen with fluorescent molecules, using methodology known in the art. Many well-known fiuorochromes are employed in specimen staining.
  • the system of Figure 5 includes a filtered light source 90 which emits light only in the frequencies necessary to excite the fluorescent dyes used to stain biological structures in the specimen.
  • a condenser lens " 92 focuses the stimulating light onto a laboratory slide 94 which carries the biological specimen 96 to be analyzed.
  • the biological specimen 96 has been stained with one or more fluorescent dyes, chosen to fluoresce in different colors when stimulated by light of the appropriate frequency produced by the light source 90.
  • the staining compounds may be chosen from a wide variety of known stains, or stains to be discovered.
  • the stains are linked to fluorescent molecules using methodology known in the art.
  • the stains can, for example, be known stains which preferentially stain the nucleus, cytoplasm, or other structures in cells, or more recently-discovered stains based on monoclonal antibodies, which attach to one particular structure for which they are designed, or recently discovered antisense DNA stains which will attach to one particular sequence of DNA, thus uniquely identifying either a known organism or known genotype.
  • a probe can be labelled with two different colors. For example, location of cells might be identified by staining the cytoplasm of the cells with a cytoplasmic stain attached to a certain fluorescent color and then staining one particular structure, for example, the receptor for a given hormone, with an antibody stain attached to a different fluorescent color.
  • the specimen, thus stained is illuminated and the image is acquired, the analysis of the image would recognize cells with receptors by contact of the two colors, whereas a cell without receptors would have the base color and not the receptor color.
  • chromosomes may be detected by staining different chromosomes with DNA probes attached to different colors. Chromosome crossover would appear to image analysis as a strand in which color changed part way through.
  • a lens 98 focuses a magnified image of the stained specimen 96 on the lens 48 of a cooled, integrating low light level color camera 10 constructed as described above.
  • Lens 98 may be a microscope or a macro lens.
  • the cooled color camera 10 produces a video output consisting of RGB signals 100 and a synchronization signal 102.
  • the preferred format of the image represented by the RGB signals is the well-known 525 line
  • the format could be, for example, a standard HDTV format.
  • the image signals 100 and synchronization signal 102 are fed to a multi-channel color image analyzer 104 comprising available color identification technology.
  • the image analyzer 104 operates to recognize or identify colors in a scanned image.
  • the image analyzer 104 is preferably programmable to permit selective definition of colors.
  • An exemplary color identification apparatus is described in detail in U.S. Patent 5,087,965, assigned to the Assignee of this application, and incorporated herein by reference.
  • the image analyzer 104 includes a color frame store into which the image produced by the camera 10 is stored.
  • the analyzer includes timing electronics which determine the integration time of the camera.
  • the color identification element of the image analyzer 104 is a multi-channel apparatus of the type taught in the incorporated patent in which each channel is trained to recognize a different one of the fluorescent colors resulting from the different fluorescent dyes in the biological structures of the specimen 96.
  • Figure 6 illustrates an image analyzer for "training" of the image recognition channels.
  • the RGB signals 100 are provided, together with the synchronization signal 102 to a conventional analog-to-digital converter 110 which converts their instantaneous analog values into digital values.
  • the digitized image produced by the camera 10 is switched by switch 112 to a frame buffer 114 where an image in the form of a scanned representation of the specimen 96 is stored in conventional format and fed through a interface 116 to a conventional multi-channel display 118.
  • the frame buffer 114 at this point contains a multi-color image of the stained specimen 96 which enables an operator to observe the colors which are present.
  • the operator then provides color select signals on a signal line 122 to a color selection apparatus 120 corresponding, for example, to the apparatus illustrated in Figure 6 of the incorporated patent.
  • the color select signals 122 are used to store compound color component information in memories which define colors of interest to the color selection apparatus 120. These memories are not shown in Figure 6, but are described in detail in the incorporated patent.
  • the colors of interest are selected by a user, for example, by moving a pointer across the displayed image and selecting various colors from the image.
  • the selection switch 112 is then set to provide the converted, digitized scanned image to the now-programmed color selection apparatus 120.
  • the color selection apparatus 120 provides an output in the form of a pixellated representation of the image acquired by the cooled camera 10 which includes only the colors indicated by the color selection signals.
  • the image including only the colors selected in the color selection circuit 120 is fed to a frame buffer 124 and output through the interface 116 to the display 118.
  • CML Chronic Myelogenous Leukemia
  • Chronic Myelogenous Leukemia is characterized by the fusion of a bcr gene on chromosome 22 and an abl oncogene on chromosome 9.
  • a reciprocal translocation frequently referred to as the Philadelphia chromosome, is found in approximately 90% of CML cases.
  • a bcr/abl translocation probe can be introduced into the nucleus.
  • the bcr/abl translocation DNA probe contains a hybridized bcr probe labelled with rhodamine (red), a hybridized abl probe labelled with fluorescein (green), and a counterstain DAPI (blue) for counterstaining the remainder of the DNA. If the nucleus does not contain a reciprocal translocation, the system produces a single multi-colored image which contains a plurality of random positioned red and green spots. However, if the nucleus contains a reciprocal translocation, the system produces a single multi-colored image which contains yellow or combined red/green spots which indicate the position of the reciprocal translocations.

Landscapes

  • Health & Medical Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Multimedia (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Signal Processing (AREA)
  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Investigating Or Analysing Biological Materials (AREA)

Abstract

A low light level color imaging system acquires polychromatic images of body cells at low light intensities when markers attached to the cells are illuminated. Particularly in PAP smear screening, specimens may be marked with a variety of fluorescent stains which have different chromatic signatures but which only weekly emit light from very low structural levels of the cells. The invention detects the color intensity of each stain in a specimen image, using an integrating color camera to acquire the image. The signal-to-noise ratio of the integrating color camera is enhanced by electronic cooling (50, etc.) of its imaging element (28). A single scanned image of a specimen acquired by the camera includes polychromatic information which identifies all of the fluorescent stains which mark the specimen. A multi-channel color image analyzer is configured to recognize each of the fluorescent colors produced from the fluorescent dyes and to provide a pixellated representation of the specimen image which includes all of the fluorescent colors at their image locations.

Description

LOW LIGHT COLOR IMAGING SYSTEM WTffl COOLED INTEGRATING CAMERA
BACKGROUND OF THE INVENTION
The invention relates to a color imaging system, and is particularly relevant to the production of a color image using an integrating, low light level, color camera for obtaining multi-color images of biological samples.
BACKGROUND OF THE INVENTION
Significant interest has focused on the use of color imaging systems to analyze biological samples. For example, U.S. Patent 5,008,185 to Bacus describes the use of an imaging system to visually analyze human breast cancer specimen cells which have been marked with an optical enhancement factor using a PAP-staining technique. The quantity of a particular protein in the stained cells is determined from a digital grey scale image of the specimen cells. A significant limitation of grey-scale analysis is that only a single color can be analyzed at a time. If the analysis is to employ more than one- color, each color necessitates a compound step consisting of staining followed by imaging.
The potential exists for providing spectral as well as grey-scale information in cell image analysis. A large number of colors can be introduced into cell specimens using conventional staining techniques. For example, a variety of colored markers are employed to stain cell specimens which are then examined visually with the aid of a microscope. Significant advantages can be gained from capturing a single multi-colored image of a stained specimen. Image analysis techniques can be used to analyze the single image thus eliminating the need in the prior art system for obtaining a plurality of images.
A new class of markers, called "fluorescent dyes", can be carried by known DNA probe techniques into very small structures in human biological specimens. Indeed, fluorescent markers can be carried by probes down to the molecular level of a cell. Ordinary dyes will not stain such small structures. However, because of the small size of fluorescent markers and the nature of their light-generating processes, the image of a specimen stained with fluorescent dyes is very dim.
To date, color cameras have been utilized for display and analysis of colored cell images. However, color cameras have not been employed to acquire colored images of cells stained by fluorescent materials because of the cameras' limited sensitivity and because of the low level of chromatic intensity provided by staining techniques. Proposals have been made to image specimens marked with fluorescent stains using image intensifiers. However, this would result in a monochromatic image and would surrender the significant advantages which a colored image gives.
Accordingly, the need exists to provide an imaging system for the display, analysis, and archiving of low light level, color images. The need is particularly acute when the image to be analyzed is a magnified visualization of a cellular specimen.
SUMMARY OF THE DISCLOSURE
The invention is directed to means and methods for display and analysis of low light level color images for microscopic or macroscopic applications. In particular, the objective of the invention is to provide a color camera for acquisition of low light level color images.
This and other objectives and distinct advantages are realized in an imaging system which includes an electronic camera which is capable of low light level color imaging. The camera includes an integrating opto-electronic imaging assembly, a cooling means, and a lens adapter frame. The integrating opto-electronic imaging assembly scans an image and produces image signals representative of intensity distributions of colors in the scanned image. The cooling means is in thermal contact with the imaging assembly and reduces imaging assembly noise in the image signals. The cooling means is mounted in a open end of a camera frame. The lens adapter frame mounts a lens adjacent to the imaging assembly. The lens adapter frame is mounted in thermal contact with the cooling means. In addition, the camera has a means acting between the imaging assembly and the lens adapter frame to prevent condensation from forming on the imaging assembly.
The electronically cooled integrating camera forms a major component of a system for low light level color imaging. The system includes a means for holding a biological sample, a filtered light source, an integrating electronic color camera, and an image analyzing means. The holding means holds a biological sample which is stained with a plurality of fluorescent dyes. The filtered light source is arranged to illuminate the stained sample. The integrating electronic color camera is arranged to receive light from the biological sample and includes an integrating opto-electric imaging device, a cooling means, and a conversion means. The integrating opto-electronic imaging device scans an image of the sample and produces image signals representative of intensity distributions of colors in the scanned image. The cooling means is positioned in thermal contact with the imaging device for cooling the imaging device and reduces imaging device noise in the signals. The conversion means is connected to the camera and converts the image signals into a plurality of mutually distinct color component signals which correspond to respective colors in the scanned image. Finally, the image analyzing means includes a color element means and an image reconstruction means. The color element means, which is coupled to receive the color component signals and is responsive to color selection signals identifying at least two colors, produces color identification signals that identify colors among the colors in the scanned image. The image reconstruction means receive the color identification signals and produces a representation of the image in the plurality of colors contained in the image.
The achievement of the above-described objectives and other objects and features of the invention will be evident when the following description is read with reference to the below-described drawings. BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 is an exploded view of a cooled, low light level color camera according to the invention.
Figure 2 is an exploded view of a cooled imaging assembly on the camera illustrated in Figure 1.
Figure 3 is a magnified, partial side sectional view of the front end of the camera illustrated in Figure 1.
Figure 4 is a schematic diagram of a circuit employed in the invention for controlling an electronic cooler in the camera of Figure 1. Figure 5 is a block diagram illustrating a low light level color imaging system including the camera of Figure 1.
Figure 6 is a block diagram illustrating in greater detail a multi-color image analyzer included in the system of Figure 5.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT Insufficient sensitivity has limited the application of color cameras in microscopic imaging of biological specimens marked with fluorescent dyes. The inventors have realized that the sensitivity of a color camera for such applications can be enhanced by the use of light integration provided by, for example, an imager such as an interlined transfer charge-coupler device (CCD) which may be referred to hereinafter as "an integrating opto-electronic device" or simply as a "CCD".
Utilization of an integrating opto-electronic device improves the sensitivity of the camera by extending image acquisition time in order to collect more photons. However, integrating opto-electronic devices such as CCD's exhibit a particular noise characteristic in the form of a dark current (iD) which leaves traces ("artifacts") in an image in the form of pixellation noise which is visualized as a random scattering of color dots across an image which are not produced by any feature of the image but, rather, by the device's response to ambient heat. Typically, a magnified visualization of a cell specimen which is magnified through a microscope must be acquired in an integrating color camera over a relatively long integration time. The pixellation noise in the image is proportional to the integration time. Therefore, an inherent tradeoff exists between integration time and a required signal to noise ratio. The invention is based on the inventors' critical realization that thermal noise effects of an integrating opto-electronic device used in a color camera to acquire low light level cell images colored by fluorescent markers might be reduced significantly by cooling the device during the integrating period. Cooling the device reduces its thermal activity and, consequently, the thermally-induced artifacts in the image acquired by the device. The inventors encountered a significant challenge in devising a means and method for cooling the imaging device which would not interfere with operation of the camera and degrade the quality of the acquired image. The resulting color camera is illustrated in Figures 1, 2, and 3. Figure 1 is an exploded view of a cooled, low light level, integrating color camera to be used in the invention. The camera assembly, indicated generally by reference numeral 10, includes a camera frame 12 with a generally rectangular cross-section, five closed sides, and an open front end 14. A color camera chassis 16 is received and mounted inside the camera frame 12. The camera chassis contains a plurality of circuit boards which contain conventional circuitry thereon, for example, a Pulnix Model TMC-74 with integration connector 12P-02, which receives a signal from a CCD and provides an electronic output (not illustrated) preferably in a form which includes separate RGB components. The invention, however, is not limited to circuitry which produces such signals, and it will be apparent to one having ordinary skill in the art that signals in other formats could serve as well. On the forward end of the camera frame 12 is mounted a cooled imaging assembly 20. The cooled imaging assembly is shown in an exploded view in Figure 2. Reference is now made to Figures 1 and 2 in describing the camera 10. A standard electronic plug or receptacle 18 is mounted on the forward end of the camera frame 12; the receptacle receives the metallic connectors of a chip carrier 24. An integrating opto-electronic device 28 ("CCD") is mounted in a recess in the chip carrier 24, which is covered by a thin sheet of transparent material (not shown). In this embodiment of the present invention, a single CCD chip is used to record an image. The chip carrier's metallic connectors are conventionally connected to the CCD 28 and are conventionally extended for this invention. Hereinafter, the connectors with extenders will be referred to as "pins" and will be indicated by reference numeral 26. A cover assembly 36 includes a bezel 40 which attaches a transparent block 34 over the CCD 28 on the chip carrier 24. When the pins of the chip carrier 24 are received in the plug 18, a lens adaptor frame 44 is positioned over the imaging device 28. The lens adaptor frame includes a threaded portion 46 for receiving a conventional imaging lens 48 shown in dashed outline.
The integrating opto-electronic device 28 is cooled by direct contact with an electronic thermal cooler assembly 30. For example, the electronic cooler assembly 30 can include a Melcor Model Thermoelectric Module Peltier cooler, No. FCO-6-66-05L. The electronic thermal cooler assembly operates conventionally to conduct heat away from the CCD 28 to a heat sink 50. For assembly, the heat sink 50 includes two parallel, elongate slots 58 through which the pins 26 of the chip carrier 24 extend when they are received in the plug receptacle 18. As Figure 2 illustrates, the electronic thermal cooler assembly 30 is sandwiched between the chip carrier 24 and the heat sink 50.
Preferably, the heat sink 50 is constructed from aluminum or copper and has a substantially rectangular shape which corresponds to the rectangular cross-section of the camera case 12. The heat sink includes a central recess 54 shaped to receive the lens adaptor frame 44 and in which the two slots 58 are disposed. Sets of convection ports 56 are disposed on either side of the recess 54 to enhance cooling of the heat sink by convection. Fans 22 (shown in Figure 1.) are mounted in the camera case 12 adjacent the heat sink in the vicinity of the convection ports 56. The fans operate to increase the flow of air through the convection ports 56 and to increase the rate of cooling of the heat sink 50.
Threaded screws (not shown) are used conventionally to attach the camera chassis 16 to the interior of the camera case 12, the heat sink 50 to the front end 14 of the camera case 12, the fans 22 to the camera case 12, the lens adaptor frame 44 to the heat sink 50 and the bezel 40 to the chip carrier 24. Figure 3 shows a cross-section of the cooled camera of the invention from the heat sink 50 forward to the lens adaptor frame 44. The view is a sectional one, just to the side of the chip carrier 24.
As those skilled in the art will realize, cooling of the chip carrier 24 and the CCD 28 can induce condensation on or over the device, which can lead to significant deterioration in the quality of the image produced by the CCD 28 and eventually to failure of the device. Further, since the chip carrier 24 is also being cooled, condensation can form on it and its pins 26 potentially interfering with the operation of the camera. In order to avoid condensation on the CCD 28 and the pins 26, the invention provides for the maintenance of a dry atmosphere for the CCD 28 and the pins 26. The means for maintaining the dry atmosphere are illustrated in Figure 3.
As Figures 1, 2, and 3 illustrate, the bezel 40 and transparent block 34 when attached to the chip carrier 24 form a space 60 over the CCD 28. This arrangement is normally provided to protect the CCD 28 from contamination and damage. The invention utilizes this arrangement to provide a dry atmosphere for the CCD 28 which is retained in the space 60 by a gasket 32 around the periphery of the bezel 40 between the bezel 40 and the chip carrier 24. The interior space 60 between the transparent block 34 and the CCD 28 contains a dry atmosphere consisting of, for example, dry nitrogen. The dry atmosphere contains no water vapor and, thus, prevents condensation on or over the CCD 28 when it is cooled.
The pins 26 are protected in the same manner by provision of a continuous seal 62 contacting and acting between an inner periphery of the lens adaptor frame 44 and an outer periphery of the bezel 40 substantially above the periphery defined by the gasket 32. The seal 62 can be in the form of, for example, an adhesive such as a clear silicone rubber cement. Additional seals 64 composed of an adhesive are provided between the pins 26 and the interior surfaces of the slots 58 of the heat sink 50. The seals 62 and 64 seal a space 66 formed by inner surfaces of the lens adaptor frame 44, the heat sink 50, and the slots 58. The space 66 contains a substantial length of the metallic connectors 26. The space 66 is filled with dry nitrogen, which prevents condensation on the metallic connectors 26 when the chip carrier 24 is cooled by the electronic thermal coolers 30.
The lens adaptor frame 44 is mounted in direct thermal contact with the heat sink 50, with the thermal conductivity between the lens adaptor 44 and heat sink 50 being enhanced by, preferably, a silicone grease and very tight contact between these pieces by highly torqued screws. Similarly, a highly conductive thermal path is provided from the chip carrier 24 through the electronic thermal coolers 30 to the heat sink 50 by tight contact and, if necessary, a silicone grease.
The camera illustrated Figures 1-3 is preferably assembled in a closed and controlled environment, for example, in a glove box containing an atmosphere of dry nitrogen. By assembling the camera in such a closed and controlled environment, the dry nitrogen is trapped in the spaces 60 and 66 shown in Figure 3 where it is remains even when the camera is removed from the glove box and operated in the manner contemplated by the invention.
The cross-sectional representation in Figure 3 shows highly conductive thermal pathways between the CCD 28 and the heat sink 50, and between the heat sink 50 and the lens adaptor frame 44. When the camera is operated to acquire an image on the CCD 28, the electronic thermal cooler assembly 30 is turned on to conduct heat away from, and thereby cool, the CCD 28. The heat sink 50 conducts the heat laterally to the left and right in Figure 2 toward the sets of convection ports 56. Operation of the fans 22 convects the heat from the heat sink 50. Referring again to Figure 3, some of the heat conducted from the chip carrier 24 and CCD 28 is returned through the lens adaptor frame 44 and radiated therefrom to the outside surface of the transparent window 38 in the bezel 40. Since this thermal pathway is relatively long, the amount of heat radiated will be relatively low, but will be of a magnitude sufficient to keep the outside of the transparent window 38 above the dew point, thereby preventing condensation on the window 38.
In another embodiment of the present invention, a three-CCD chip arrangement is used to record an image. A three-CCD chip arrangement is illustrated in Figure 7. A filter 130 can be placed in front of the CCD chips 132, 134, 136 to split the image into specific color components. The specific color components can then be sent to different CCD chips. In one embodiment, a single filter may be used or a three filter configuration can be used to divide the visible color spectrum into three regions. Furthermore, the present invention need not be limited to only the visible portion of the spectrum but may also include electromagnetic radiation in the ultraviolet and infrared portions of the spectrum. The term "light" will be used to include all of these portions of the spectrum.
Figure 4 illustrates, in the form of a block diagram, a power circuit for controlling the operation of the cooling elements. A plug 70 receives an AC input which, when switch 72 is closed, is conducted to an AC socket 74 into which a main power supply (not shown) for the camera chassis shown in Figure 1 is plugged. AC power provided to the socket 74 is also provided to a second switch 76 that controls power for fans 22 and the electronic thermal cooling assembly 30 shown in Figures 1-3. When the switch 76 is closed, AC power is provided for conversion by a linear power supply 78. the lamps 75 are power indication lamps. The power supply 106 converts and filters the AC power, providing a +6 volt DC output. The DC output is fed into a plurality of connections 84, 86, and 88 in an output plug 82. The connections can then be used to provide τ»ower to the electronic components of the camera. For example, the connecαon 84 can provide power to the cooling fans 22 illustrated in Figure 1, while the connection 88 can provide power to the electronic thermal cooler 30 illustrated in Figure 2. A switch 80, when opened, interrupts the power supplied to the fans 22, but does not interrupt the power supplied to the electronic thermal cooler assembly 30. The switch 80 thus eliminates vibration caused by the fans, without interrupting the thermo-electric cooling of the CCD 28 when a very highly magnified image is being acquired. The switch 76 shuts off the active cooling elements of the cooled camera, while permitting the camera chassis electronics to warm up.
Figure 5 is a functional block diagram of an image analysis system which employs the cooled low light level color camera described and illustrated above to produce a single, multi-colored electronic image corresponding to a microscopic visualization of a specimen stained with fluorescent dyes. General details of the system of Figure 5 relating to instrument control and mechanization, and specific details of image acquisition and controlling can be understood with reference, for example, to the above-referenced Bacus patent. Figure 5 assumes that a biological specimen on a laboratory slide has been stained by a procedure which selectively marks cell characteristics in the specimen with fluorescent molecules, using methodology known in the art. Many well-known fiuorochromes are employed in specimen staining. Some examples are 5(6) carboxyfluorescein- N-hydroxysuccinimide ester and 5(6) carboxyrhodamine- N-hydroxysuccinimid ester. The system of Figure 5 includes a filtered light source 90 which emits light only in the frequencies necessary to excite the fluorescent dyes used to stain biological structures in the specimen. A condenser lens" 92 focuses the stimulating light onto a laboratory slide 94 which carries the biological specimen 96 to be analyzed. Preferably, the biological specimen 96 has been stained with one or more fluorescent dyes, chosen to fluoresce in different colors when stimulated by light of the appropriate frequency produced by the light source 90.
The staining compounds may be chosen from a wide variety of known stains, or stains to be discovered. The stains are linked to fluorescent molecules using methodology known in the art. The stains can, for example, be known stains which preferentially stain the nucleus, cytoplasm, or other structures in cells, or more recently-discovered stains based on monoclonal antibodies, which attach to one particular structure for which they are designed, or recently discovered antisense DNA stains which will attach to one particular sequence of DNA, thus uniquely identifying either a known organism or known genotype.
One advantage in this invention is that it makes it possible to use several different combinations of markers simultaneously. In addition, a probe can be labelled with two different colors. For example, location of cells might be identified by staining the cytoplasm of the cells with a cytoplasmic stain attached to a certain fluorescent color and then staining one particular structure, for example, the receptor for a given hormone, with an antibody stain attached to a different fluorescent color. When the specimen, thus stained, is illuminated and the image is acquired, the analysis of the image would recognize cells with receptors by contact of the two colors, whereas a cell without receptors would have the base color and not the receptor color.
Alternatively, chromosomes may be detected by staining different chromosomes with DNA probes attached to different colors. Chromosome crossover would appear to image analysis as a strand in which color changed part way through.
These two examples are illustrative of the desirability of acquiring in a single image the spectral information generated by multi-color fluorescent staining of a specimen. In the Bacus apparatus, multiple exposures would have to be acquired, one for each color. Further, a separate filter must be used for each image. Typically, the surfaces of the different filters do not match, which leads to shifts in the image between exposures. Before the invention of the above-described imaging system, no device existed which could acquire a single multi-color image of a type contemplated in the system of Figure 5.
Continuing with the description of Figure 5, a lens 98 focuses a magnified image of the stained specimen 96 on the lens 48 of a cooled, integrating low light level color camera 10 constructed as described above. Lens 98 may be a microscope or a macro lens. As described above, the cooled color camera 10 produces a video output consisting of RGB signals 100 and a synchronization signal 102. The preferred format of the image represented by the RGB signals is the well-known 525 line
RS170 standard timing scanned format; in the future, the format could be, for example, a standard HDTV format.
The image signals 100 and synchronization signal 102 are fed to a multi-channel color image analyzer 104 comprising available color identification technology. Preferably, the image analyzer 104 operates to recognize or identify colors in a scanned image. The image analyzer 104 is preferably programmable to permit selective definition of colors. An exemplary color identification apparatus is described in detail in U.S. Patent 5,087,965, assigned to the Assignee of this application, and incorporated herein by reference.
The image analyzer 104 includes a color frame store into which the image produced by the camera 10 is stored. The analyzer includes timing electronics which determine the integration time of the camera. Preferably, the color identification element of the image analyzer 104 is a multi-channel apparatus of the type taught in the incorporated patent in which each channel is trained to recognize a different one of the fluorescent colors resulting from the different fluorescent dyes in the biological structures of the specimen 96. Figure 6 illustrates an image analyzer for "training" of the image recognition channels. In Figure 6, the RGB signals 100 are provided, together with the synchronization signal 102 to a conventional analog-to-digital converter 110 which converts their instantaneous analog values into digital values. Initially, the digitized image produced by the camera 10 is switched by switch 112 to a frame buffer 114 where an image in the form of a scanned representation of the specimen 96 is stored in conventional format and fed through a interface 116 to a conventional multi-channel display 118.
The frame buffer 114 at this point contains a multi-color image of the stained specimen 96 which enables an operator to observe the colors which are present. The operator then provides color select signals on a signal line 122 to a color selection apparatus 120 corresponding, for example, to the apparatus illustrated in Figure 6 of the incorporated patent. The color select signals 122 are used to store compound color component information in memories which define colors of interest to the color selection apparatus 120. These memories are not shown in Figure 6, but are described in detail in the incorporated patent. The colors of interest are selected by a user, for example, by moving a pointer across the displayed image and selecting various colors from the image. The selection switch 112 is then set to provide the converted, digitized scanned image to the now-programmed color selection apparatus 120. The color selection apparatus 120 provides an output in the form of a pixellated representation of the image acquired by the cooled camera 10 which includes only the colors indicated by the color selection signals. The image including only the colors selected in the color selection circuit 120 is fed to a frame buffer 124 and output through the interface 116 to the display 118.
An example of staining a sample and producing a single multi-colored image is described below. This example discusses Chronic Myelogenous Leukemia (CML), wherein Chronic Myelogenous Leukemia is characterized by the fusion of a bcr gene on chromosome 22 and an abl oncogene on chromosome 9. A reciprocal translocation, frequently referred to as the Philadelphia chromosome, is found in approximately 90% of CML cases. In order to determine whether a human interphase nucleus contains a reciprocal translocation, a bcr/abl translocation probe can be introduced into the nucleus. The bcr/abl translocation DNA probe contains a hybridized bcr probe labelled with rhodamine (red), a hybridized abl probe labelled with fluorescein (green), and a counterstain DAPI (blue) for counterstaining the remainder of the DNA. If the nucleus does not contain a reciprocal translocation, the system produces a single multi-colored image which contains a plurality of random positioned red and green spots. However, if the nucleus contains a reciprocal translocation, the system produces a single multi-colored image which contains yellow or combined red/green spots which indicate the position of the reciprocal translocations.
It will be appreciated by those of ordinary skill in the art that the present invention can be embodied in other specific forms without departing from the spirit or essential character thereof. The presently disclosed embodiments are therefore considered in all respects to be illustrative and not restrictive. The scope of the invention is indicated by the appended claims rather than the foregoing description, and all changes which come within the meaning and range of equivalents thereof are intended to be embraced therein.

Claims

IN THE CLAIMS:
1. An imaging apparatus for obtaining an image of a biological sample, comprising: means for holding said biological sample, said biological sample being stained with a plurality of fluorescent dyes; an integrating electronic color camera arranged to receive light from said biological sample, said integrating color camera including an integrating opto-electronic imaging device for scanning an image of said biological sample, and for producing image signals representative of intensity distributions of colors in the scanned image, a cooling means in thermal contact with the imaging device for cooling said imaging device to reduce imaging device noise in the image signals, and a conversion means connected to the imaging device for converting the imaging signals into a plurality of mutually distinct color component signals which correspond to respective colors in the scanned image; and image analyzing means, including a color element means, coupled to receive the color component signals and responsive to color selection signals identifying at least two colors, for producing color identification signals that identify colors among the colors in the scanned image, and image reconstruction means coupled to receive the color identification signals for producing a representation of the image in the plurality of colors contained in the image.
2. An imaging apparatus for obtaining an image of a biological sample according to claim 1, wherein said integrating opto-electronic image device is a single CCD chip.
3. An imaging apparatus for obtaining an image of a biological sample according to claim 1 , wherein said integrating opto-electronic imaging device comprises three CCD chips.
4. An imaging apparatus for obtaining an image of a biological sample according to claim 3, further comprising at least one filter means situated between said biological specimen and said integrating opto-electronic imaging device for separating specific color components of said image and directing separated color components respectively to one of said three CCD chips.
5. An imaging apparatus for obtaining an image of a biological sample according to claim 4, wherein said filter means comprises three filters.
6. An imaging apparatus for obtaining an image of a biological sample according to claim 4, wherein said filter means comprises three filters which respectively separate said image into infrared light, visible light and ultraviolet light components.
7. An imaging apparatus for obtaining an image of a biological sample according to claim 1, further comprising a storing means coupled to said image reconstruction means for storing said representation of said image.
8. An imaging apparatus for obtaining an image of a biological sample according to claim 1, further comprising a filtered light source arranged to illuminate said biological sample. 9. An imaging apparatus for obtaining an image of a biological sample according to claim 8, wherein said filtered light source emits light only in the frequencies necessary to excite said fluorescent dyes.
10. An imaging apparatus for obtaining an image of a biological sample according to claim 1, wherein said imaging signals are RGB signals.
11. An imaging apparatus for obtaining an image of a biological sample according to claim 10, wherein said RGB signals are formatted in a 525 line RS170 standard timing scanned format.
12. An imaging apparatus for obtaining an image of a biological sample according to claim 10, wherein said RGB signals are formatted in a standard HDTV format.
13. An imaging apparatus for obtaining an image of a biological sample according to claim 1, wherein said plurality of fluorescent dyes have at least two fluorescent colors.
14. An imaging apparatus for obtaining an image of a biological sample according to claim 1 , further including display means connected to the image reconstruction means for displaying the image in the colors of the two or more colors which are contained in the image on a screen.
15. A method for obtaining a multi-color image of a biological sample, comprising the steps of: staining said biological sample with a plurality of fluorescent dyes; cooling an imaging device to reduce noise in imaging signals produced by said imaging device; forming an image of said stained sample at said imaging device; producing image signals representative of intensity distribution of colors in said image; analyzing said image signals to produce a representation of said multi-color image of said stained sample.
16. A method for obtaining a multi-color image of a biological sample according to claim 15, further comprising the step of: selectively discriminating colors in said scanned image to retain in the image only colors which correspond to colors produced by the fluorescent dyes.
17. A method for obtaining a multi-color image of a biological sample according to claim 16, further comprising the step of: displaying the image of said stained sample using only the colors which correspond to colors produced by said fluorescent dyes.
18. An electronic camera for low light level color imaging, comprising: a frame with an open front end; an integrating opto-electric imaging assembly for scanning an image and producing image signals representative of intensity distributions of colors in the scanned image; a cooling means in thermal contact with said imaging assembly for electronically cooling said imaging assembly to reduce imaging assembly noise in the image signals, said cooling means being mounted in said open front end of said frame; a lens adapter frame for mounting a lens adjacent to said imaging assembly, said lens adapter frame being mounted in thermal contact with said cooling means; and means acting between said imaging assembly and said lens adapter frame for preventing condensation on said imaging assembly. 19. An electronic camera according to claim 18, wherein said integrating opto-electric imaging assembly includes: a charge-coupled device; and a chip carrier means for holding said charged-coupled device, said chip carrier means having a plurality of connectors which pass through said cooling means and carry said image signals to an image analyzer.
20. An electronic camera according to claim 19, wherein said imaging assembly contains a plurality of charged-coupled devices.
21. An electronic camera according to claim 19, wherein said connectors are surrounded by a dry gas which prevents condensation from forming on said connectors.
22. An electronic camera according to claim 118, wherein said cooling means includes: a heat sink, said heat sink having a recess for receiving said lens adapter frame and a plurality of convection ports; an electronic thermal cooling means mounted in thermal contact with said heat sink and said imaging assembly; and at least one fan mounted adjacent to said heat sink for convectively cooling said heat sink.
23. An electronic camera according to claim 22, wherein said heat sink contains a plurality of elongated slots which allow connectors from said imaging assembly to pass through said heat sink to an image analyzer.
24. An electronic camera according to claim 23, wherein said connectors are surrounded by a dry gas which prevents condensation from forming on said connectors. 25. An electronic camera according to claim 18, wherein said condensation prevention means includes: a transparent block through which light forming said image passes through; a cover assembly with a transparent window and a bezel for receiving said transparent block; and a gasket between said imaging assembly and said transparent block, said gasket creating a sealed space in between said transparent block and said imaging assembly.
26. An electronic camera according to claim 25, wherein said sealed space contains a dry gas which prevents condensation from forming on said imaging assembly.
27. An electronic camera according to claim 26, wherein said dry gas is dry nitrogen.
EP93917039A 1992-07-08 1993-07-08 Low light color imaging system with cooled integrating camera Withdrawn EP0691064A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US91070892A 1992-07-08 1992-07-08
US910708 1992-07-08
PCT/US1993/006442 WO1994001968A1 (en) 1992-07-08 1993-07-08 Low light color imaging system with cooled integrating camera

Publications (2)

Publication Number Publication Date
EP0691064A4 true EP0691064A4 (en) 1995-11-03
EP0691064A1 EP0691064A1 (en) 1996-01-10

Family

ID=25429219

Family Applications (1)

Application Number Title Priority Date Filing Date
EP93917039A Withdrawn EP0691064A1 (en) 1992-07-08 1993-07-08 Low light color imaging system with cooled integrating camera

Country Status (5)

Country Link
EP (1) EP0691064A1 (en)
JP (1) JPH07509819A (en)
AU (1) AU4669593A (en)
CA (1) CA2139754A1 (en)
WO (1) WO1994001968A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5834203A (en) * 1997-08-25 1998-11-10 Applied Spectral Imaging Method for classification of pixels into groups according to their spectra using a plurality of wide band filters and hardwire therefore
EP1576806A1 (en) * 2002-12-04 2005-09-21 Applied Precision, LLC Thermally efficient ccd camera housing
US8644580B2 (en) * 2008-08-07 2014-02-04 Cambridge Research & Instrumentation, Inc. Detection of RNA in tissue samples
US8416302B2 (en) 2009-02-10 2013-04-09 Microsoft Corporation Low-light imaging augmented with non-intrusive lighting
AU2012365929B2 (en) * 2012-01-19 2015-11-05 Shanghai Ruishi Machine Vision Technology Co., Ltd. Camera with built-in polaroid switching mechanism
FR3037399B1 (en) * 2015-06-12 2019-06-14 Commissariat A L'energie Atomique Et Aux Energies Alternatives IMAGING DEVICE WITHOUT LENS
CN115308176B (en) * 2022-07-26 2024-09-13 山东大学 Oral mucosa multi-frequency fluorescence imaging system and method for discriminating cancerous cells

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS58148572A (en) * 1982-02-27 1983-09-03 Sony Corp Solid-state image pickup device
DE3304782A1 (en) * 1983-02-11 1984-08-16 Egyt Gyógyszervegyészeti Gyár, Budapest Method and measuring device for the non-destructive quick non-identification of inorganic and organic substances
GB2146865A (en) * 1983-09-16 1985-04-24 Rca Corp Camera with reduced condensation cooled solid-state imager
EP0311368A2 (en) * 1987-10-06 1989-04-12 Cell Analysis Systems, Inc. Methods and apparatus for the quantitation of nuclear proteins
DE3812899A1 (en) * 1988-04-18 1989-10-26 Wilfried Heil Electronic camera for the documentation of fluorescence patterns on electrophoretic gels
JPH0271683A (en) * 1988-09-06 1990-03-12 Fuji Photo Film Co Ltd Ccd package
EP0405790A2 (en) * 1989-06-28 1991-01-02 Oncor, Inc. Recognition of image colors using arbitrary shapes in color space
WO1993003575A1 (en) * 1991-08-05 1993-02-18 Dalsa Inc. Modular camera with expandable or interchangeable functionalities
US5216250A (en) * 1991-11-27 1993-06-01 Lorad Corporation Digital imaging system using CCD array
JPH06331278A (en) * 1993-05-26 1994-11-29 Nippon Steel Corp Monitoring method of insulation of dc arc furnace

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4551760A (en) * 1983-09-16 1985-11-05 Rca Corporation Television camera with solid-state imagers cooled by a thermal servo
US4547809A (en) * 1984-04-27 1985-10-15 Rca Corporation Thermally isolated imager
US4587563A (en) * 1984-09-28 1986-05-06 Rca Corporation Cooler control for a solid-state imager camera
US4998284A (en) * 1987-11-17 1991-03-05 Cell Analysis Systems, Inc. Dual color camera microscope and methodology for cell staining and analysis
JPS6331278A (en) * 1986-07-24 1988-02-09 Matsushita Electric Ind Co Ltd Solid-state image pickup device
US4739409A (en) * 1986-10-10 1988-04-19 Eastman Kodak Company Intelligent exposure control for electronic cameras
GB2196219A (en) * 1986-10-11 1988-04-20 Astromed Ltd Imaging of light-opaque specimens by transmission of radiation therethrough

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS58148572A (en) * 1982-02-27 1983-09-03 Sony Corp Solid-state image pickup device
DE3304782A1 (en) * 1983-02-11 1984-08-16 Egyt Gyógyszervegyészeti Gyár, Budapest Method and measuring device for the non-destructive quick non-identification of inorganic and organic substances
GB2146865A (en) * 1983-09-16 1985-04-24 Rca Corp Camera with reduced condensation cooled solid-state imager
EP0311368A2 (en) * 1987-10-06 1989-04-12 Cell Analysis Systems, Inc. Methods and apparatus for the quantitation of nuclear proteins
DE3812899A1 (en) * 1988-04-18 1989-10-26 Wilfried Heil Electronic camera for the documentation of fluorescence patterns on electrophoretic gels
JPH0271683A (en) * 1988-09-06 1990-03-12 Fuji Photo Film Co Ltd Ccd package
EP0405790A2 (en) * 1989-06-28 1991-01-02 Oncor, Inc. Recognition of image colors using arbitrary shapes in color space
WO1993003575A1 (en) * 1991-08-05 1993-02-18 Dalsa Inc. Modular camera with expandable or interchangeable functionalities
US5216250A (en) * 1991-11-27 1993-06-01 Lorad Corporation Digital imaging system using CCD array
JPH06331278A (en) * 1993-05-26 1994-11-29 Nippon Steel Corp Monitoring method of insulation of dc arc furnace

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN vol. 12, no. 244 (E - 631) 9 July 1988 (1988-07-09) *
PATENT ABSTRACTS OF JAPAN vol. 14, no. 252 (E - 934) 30 May 1990 (1990-05-30) *
PATENT ABSTRACTS OF JAPAN vol. 7, no. 267 (E - 213) 29 November 1983 (1983-11-29) *
See also references of WO9401968A1 *

Also Published As

Publication number Publication date
WO1994001968A1 (en) 1994-01-20
CA2139754A1 (en) 1994-01-20
JPH07509819A (en) 1995-10-26
AU4669593A (en) 1994-01-31
EP0691064A1 (en) 1996-01-10

Similar Documents

Publication Publication Date Title
US11947096B2 (en) Microscopy imaging
KR101349664B1 (en) Microscope with led illumination source
US8119997B2 (en) Optical system and method for inspecting fluorescently labeled biological specimens
US5672881A (en) Charge-coupled device imaging apparatus
EP2943761B1 (en) Multispectral imaging system and methods
Chieco et al. Image cytometry: protocols for 2D and 3D quantification in microscopic images
US7864380B2 (en) Slide-borne imaging instructions
US20120300194A1 (en) Universal multidetection system for microplates
CA2577299C (en) A diagnostic imaging device for the analysis of circulating rare cells
CN105007392A (en) Image forming apparatus, image forming method, and image forming system
EP2527820B1 (en) Fluorometric assay apparatus and fluorometric assay method
EP0691064A1 (en) Low light color imaging system with cooled integrating camera
Jonker et al. Basic strategies for valid cytometry using image analysis
US20100144053A1 (en) Multiplex assay reader system
EP0990896A2 (en) Large area image analysing apparatus
EP0840114B1 (en) Image Producing Apparatus
US7777885B2 (en) Diagnostic imaging device for the analysis of circulating rare cells
WO2013181347A1 (en) Universal multi-detection system for microplates
CN111465858A (en) Combined imaging of assays
WO2003003057A2 (en) System and method for capturing multi-color fish images
Ikami et al. Development of a Next-generation CCD Imager for Life Sciences Research
CN112798593A (en) Microscopic observation device and method for liquid-based sample
Wilson et al. Video Microscopy
JPH1055428A (en) Image reader
JP2004126651A (en) Method and device for displaying image processing requirement

Legal Events

Date Code Title Description
A4 Supplementary search report drawn up and despatched
AK Designated contracting states

Kind code of ref document: A4

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LI LU MC NL PT SE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 19950127

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LI LU MC NL PT SE

17Q First examination report despatched

Effective date: 19971016

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 19980227