GB1579188A

GB1579188A - Method and apparatus for duel resolution analysis of a scene

Info

Publication number: GB1579188A
Application number: GB18748/77A
Authority: GB
Original assignee: Individual
Current assignee: Individual
Priority date: 1976-05-04
Filing date: 1977-05-04
Publication date: 1980-11-12
Also published as: DE2720036C2; FR2350596A2; SE7705157L; NL7704914A; CH620297A5; JPS52142587A; DE2720036A1; FR2350596B2

Abstract

The sample to be analysed is examined in a first field, of low resolution, of the apparatus; if an object thus detected belongs to a specified category, for example the category of leucocytes in the case of a blood sample, it is subjected to a second analysis in a second field, of higher resolution, the low-resolution examination being nevertheless continued in order to detect the possible presence of another object. The apparatus comprises a sample holder (1) which can be moved in two directions using motors (2 and 3), and which holds a sample (4) comprising several particles (5a, 5b, 5c) of interest. An objective (6) forms an image (10) of a part (7) of the sample on a low-resolution sensor (9), and does this using a plate (6b) and an optical system (8), and an image (14) of a part (11) of the sample on a high-resolution sensor (13), and does this using a second optical system (12). The output signal from the low-resolution sensor (9) is analysed so that when a particle of interest is encountered, the sample holder is moved in order to bring the particle into the field of view of the high-resolution sensor, which allows its high-resolution analysis by a corresponding analyser (37). This method and this apparatus make it possible to analyse in detail only the objects of interest, without having to perform a detailed analysis of all the objects present. This method and this apparatus may be used for analysing blood cells, scrapings or cancer cells. <IMAGE>

Description

(54) METHOD AND APPARATUS FOR DUAL RESOLUTION ANALYSIS OF A SCENE (71) I, JAMES EDMOND GREEN, a citizen of the United States of America, of Post Office Box 734, Fayetteville, State of Tennessee, United States of America, do hereby declare the invention, for which I pray that a patent may be granted to me, and the method by which it is to be performed, to be particularly described in and by the following statement: The present invention relates to a scene analysis apparatus and methods and more particularly, to a method and apparatus in which a a scene is scanned at two different resolutions. Such a method and apparatus are described in U.K. Specification No.

1505763.

In many areas of particle analysis, such as, blood cell analysis or pap smear analysis, the particles of interest are widely distributed in a field and are surrounded by many particles of no interest at all. For example, white blood cells may be surrounded by hundreds of red blood cells while cancerous or dysplastic cervical cells may be surrounded by tens-to-thousands of normal cervical cells and debris.

It is desirable to analyze in detail only the particles of interest in the scene. This can be accomplished by the detailed analysis of all objects in order to exclude the unwanted objects. However, this technique is very time-consuming and therefore relatively impractical from a commercial standpoint.

Alternately, one can use a single sensor to search for particles of interest at a low resolution and then switch the sensor to a higher resolution for analysis when a particle of interest is found in the sample.

However, this method requires mechanical or electrical switching of the analysis resolution with a concomitant limitation of a single mode of operation at any given time.

The use of simultaneous multiple resolution analysis of a plurality of fields overcomes the limitations of prior art analysis systems. Dual resolution scanning systems have been used by several workers. Aldrich et al disclosed in U.S. Patent No. 3,448,271 a dual resolution scanning system which centers and tracks celestial objects. In this system two coaxial images at different magnifications are employed to acquire and track stars or the solar disc. The scanned output of a single sensor is used as an on or off-axis signal in a feedback loop to center the star image on the optical axis. No image analysis of the celestial objects is performed or envisioned. In fact, the superimposed images on the single detector would confuse an attempt to analyze the scanner output.

Similarly, Ward in U.S. Patent No.

3,614,449 discloses a dual resolution scanning system for acquiring and tracking a distant source of light (the target). Ward describes the same type coaxial dual resolution system in which both images are projected onto a single sensor. In addition, there is a second sensor responsive to a narrow spectral band ranging source emitted by the system and reflected by the target. Although the ranging subsystem is functionally separate from the dual resolution centering and tracking system, it is housed in the same assembly for compactness in a NASA application. Again, there is no image analysis disclosed or envisioned by either the acquiring-tracking system or the ranging subsystem.

Other uses of dual resolution scanning have been disclosed, such as Gard in U.S.

Patent No. 3,804,976, which uses the scanned images for display purposes. However, no image analysis is revealed or envisioned by these disclosures.

Adkins in U.S. Patent No. 3,864,564 discloses a dual resolution scanning system in which a low resolution, one dimensional scan is used for finding and positioning a blood cell, and a high resolution twodimensional scan is used to analyze the cell.

The high resolution sensor is a videcon type T.V. camera which is well suited to the analysis of the centered blood cell. However, the low resolution sensor is a single photodetector. The image is swept across the photodetector by means of a rotating mirror thereby producing a one-dimensional line scan of the low resolution scene. The low resolution signal is used only to detect and center the cell for analysis by the high resolution sensor. Analysis by the low resolution portion of the system is not disclosed or envisioned. In fact, any analysis using the onc-dimensional information provided by the low resolution line scanner would be difficult and limited.

A system such as that described by Adkins has several limitations. To use the blood cell example, if there were several classes of cells detected by the low resolution acquisition and centering system, and it was desired to perform a detailed analysis on only a subset of these cells, it would be necessary to acquire and center all detected cells and perform a detailed analysis on them all using Adkins system. Thus much additional unnecessary effort would be necessary. In the case of pap smears, where there may be thousands of normal cells to evcry cancer cell, the extra work necessary to perform a detailed analysis on every normal cell to find a single cancer call would render a commercial application impractical.

In many cases it is possible to derive enough information from a preliminary low resolution analysis to determine if a detected object warrants further detailed analysis. The present invention provides for such dual resolution analysis with the low resolution analysis of a large field occurring simultaneously with the high resolution analysis of an object of interest. Using the previously mentioned blood cell example, artifacts such as dirt or large stain crystals can and do occur on blood smears. A simple prcliminary measurement of object size is usually adequate to allow exclusion of these artifacts from the detailed high resolution analysis. A more complex low resolution analysis can be employed if desired.

It is accordingly, a general object of the invention to provide a method and apparatus for scene analysis which overcomes the limitations of the prior art systems.

Thus from a first aspect the present invention consists in a method for dual resolution analysis of a scene comprising the steps of scorching the scene at a low resolution to detect an object therein: analysing the detected object to determine if it is an object of interest; and. analysing the object of interest at a.higher resolution while continuing to search the scene at the lower resolution to detect any other objects therein.

From a second aspect the invention consists in a dual resolution scene analysis apparatus comprising means for detecting when an object is encountered during the low resolution search; means for analysing the detected object to determine if it is an object of interest; means for analysing the object of interest at a higher resolution; means responsive to said detected object analysing means for initiating the object of interest analysis by said higher resolution analysing means while said low resolution searching means continues to search the scene to detect any other objects therein.

In order that the present invention may be more readily understood a preferred embodiment thereof will now be described by way of example and with reference to the accompanying drawings, in which: Figure 1 is a diagrammatic perspective view of a dual resolution, analysis apparatus constructed in accordance with the present invention, Figure 2 is a block diagram of the electrical circuitry for analyzing the large field at low resolution, determining if an object of interest is present in the scene, and determining the coordinates thereof; Figure 3 is a detailed functional block diagram of the data flow in a representative low resolution analysis; Figures 4A through to 4D illustrate various relationships between the low resolution field and the higher resolution field; and Figure 5 is another diagrammatic view illustrating an alternative embodiment of the dual resolution analysis apparatus.

Turning now to the drawings, Figure 1 illustrates in diagrammatic form and perspective view, the dual resolution analysis apparatus of the present invention. A sample carrier 1, which can be moved in both the X and Y directions by means of drive motors 2 and 3, contains a sample 4 which has a plurality of objects of interest Sa, Sb, and Sc. In the blood cell embodiment, the sample carrier 1 normally comprises a glass slide upon which the blood sample 4 is spread in a conventional manner. It will be appreciated that the blood sample will contain many red blood cells, a number of dispersed white blood cells of interest i.e.

cells Sa, Sb and Sc etc., white cell clumps platelets, platelet clumps, and artifacts such as dust particles and stain percipitate.

A primary optical objective 6, such as a microscope objective, forms an image of an area of the sample. The area of the sample which is designated "a low resolution field" 7 is imaged by the primary objective 6, beam splitter 6b and a low resolution secondary optic 8 onto a low resolution sensor 9. The image of the low resolution field 7 on the low resolution sensor 9 is indicated by the reference numeral 10. A relatively smaller area of the sample, termed a "higher resolution field" 11, is imaged by the primary objective 6 and a secondary high resolution optic 12 onto a high resolution sensor 13.

The high resolution image on the high resolution sensor 13 is identified by the reference numeral 14.

Conventional opto-electrical image scanners can be used for the low and high resolution sensors 9 and 11, respectively.

For example, the opto-electrical scanning sensors can comprise a television -camera, image dissector, photodiode array, or the like. The opto-electrical sensors convert the respective images into electrical signals in a well known manner.

In the preferred embodiment the low resolution signal output from sensor 9 appears on line 14b and is used to analyse the low resolution field and determine if an object of interest is present and if so to establish the position of said object of interest (white cell) such as Sa, Sb or Sc relative to the higher resolution field 11, so that appropriate signals can be generated to move the object of interest into the higher resolution field for more detailed analysis.

In the embodiment illustrated in Figure 1, the object or interest is moved into the higher resolution field 11 by moving the sample carrier 1 in the X and Y directions by means of drive motors 2 and 3. It will be appreciated that the equivalent relative movement can be achieved by moving the optical system and leaving the sample carrier fixed. Such an arrangement is illustrated in Figure S and will be discussed subsequently.

Representative circuitry for analyzing the large field at low resolution for a new object of interest, calculating its coordinates and producing appropriate output signals for actuating the drive motors 2 and 3 to move the object of interest into the higher resolution field 11 is depicted in block diagram form in Figure 2. The low resolution sensor signal output on line 15 is inputed into a low resolution analyzer 16. A number of different analyzers can be used for the low resolution analysis depending on the characteristics of the particular sample under analysis. One such analyzer is described in U.K. Patent Specification 1449501. This analyzer would be employed if an extensive low resolution analysis were desired.

The low resolution image analyzer 16 outputs a load signal on line 17 when it recognizes an object which warrants further detailed analysis. Assuming that the low resolution sensor 9 scans in a raster fashion and has 64 x 64 resolution elements (re sels), the position of the scanner can be tracked by means of 64 bit X and Y counters 19 and 20 respectively. The X and Y counters are reset by means of reset line 21 before the beginning of each scan. During the scan, clock line 18 increments the X counter 19 each time the scanner senses one resel on a horizontal scan line. At the end of each horizontal scan line, the X counter overflows and the overflow signal, on overflow line 22, is used to increment the Y counter 20.

Associated with the X and with Y counters 19 and 20 are corresponding X and Y registers 23 and 24, respectively. The X register 23 is connected to the X counter and the Y register 24 is connected to the Y counter so that when the "load" signal is present on line 17 the contents of the X counter are transferred to the X register and the contents of the Y counter are transferred to the Y register. Thus, when an object of interest is analyzed by the low resolution analyzer 16, the position of that particular object in the low resolution field 7 is stored in the X and Y registers 23 and 24.

The outputs of the X and Y registers appear on output busses 25 and 26. The two output busses feed into corresponding add/ subtractors 27 and 28 in which the position of the higher resolution field 11 relative to the low resolution field 7 is subtracted (or added as the case may be) to produce the proper X-move and Y-move signals on output lines 29 and 30. The X and Y motor drive circuitry 31 and 32 transforms the X and Y move signals into electrical signals on lines 35 and 36 respectively appropriate to produce the movements represented by the X-move and the Y-move signals.

It should be noted that the Figure 2 circuitry will have stored the position of the last object in the low resolution field 7 at the end of a scan. However, it will be appreciated that it is possible to inhibit the "load" signals after the first encountered object of interest so that the position of the first object is saved instead of the last object.

The X-overflow from Y counter 20 is used to inhibit the command of the motor movements through an "end of frame move enable" circuit 40 until the final change in the X and Y registers 23 and 24.

If low resolution analyzer is of the kind described in U.K. Patent Specification No.

1449501 and shown in the functional block diagram of Figure 3, is employed in the embodiment being described, the X and Y position signals are derived from the stored partial features of the cells. This is illustrated in Figure 3 by the X and Y position outputs. The position information is obtained from the low resolution sensor and is delayed or not delayed in the same manner as the cell data. The Y-overflow signal is replaced by an end of analysis signal to trigger the move enable.

The preceding brief discussion of an illustrated relatively complex low resolution analyzer is directed to the data processing of a single object of interest. It will be appreciated that multiple objects of interest can be handled with suitable storage and processing capability.

It will be appreciated that when the object of interest detected by the low resolution analyzer has been moved into the field of view of the high resolution sensor, the movement also positioned a new scene in the field of view of the low resolution sensor. While the high resolution field is being scanned and analyzed by the high resolution sensor and high resolution analysis means, the low resolution field can be scanned and analyzed by the low resolution sensor and low resolution analyzer to determinc if there is another object of interest in the new low resolution field. Thus, when the detailed scan of the object in the high resolution field is complete, the X and Y registers 23 and 24 will contain the coordinates of a new object of interest if one was present in the low resolution field.This feature of the invention which allows the simultaneous or ncarly simultaneous analysis of the sample at multiple resolutions results in considerable increase in system speed ovcr a system which must perform these tasks in a sequential manner.

It should also be observed that the rela tivc position of the higher resolution field 11 with respect to the low resolution field 7 as shown in Figure 1 is only one of a number of possible positions. Figure 4 illustrates some of the possible relative positions for the two resolution fields. In Figure 4A, the higher resolution field 1 ib is shown positioned at the center of the low resolution field 7.

Other locations within the low resolution field can be employed as illustrated in Figure 4B. The higher resolution field also can partially ovcrlap the low resolution field as illustrated in Figure 4C or be located entircly outside of the low resolution field as depicted in Figure 4D. These four arrange mcnts are not intended to be exhaustivc, but should be construed as being mercly illustrated of a large number of possible arrange mcnts.

It has been mcntioned previously that it is not necessary to physically move the sample carrier 1 in order to move an object of interest into the higher resolution field.

Looking at Figure 5, the sample carrier is identified as ib and the sample as 4b. Drive motors 2b and 3b are employed to drive movable mirrors 33 and 34 which change the area of the sample 4b scanned by the high and low resolution fields without physically moving the sample. Generally, this particular configuration is practical only if the working distance of the primary optical objective 6 is sufficient to allow the mirrors to be conveniently positioned between it and the sample while maintaining relatively uniform focus.

It will be appreciated that the relative movement of higher resolution field with respect to the object of interest can be accomplished either with or without a corresponding relative movement of the low resolution field 7. In the preferred embodiment, both the low and high resolution fields are moved relative to the object of interest to bring the object of interest into the higher resolution field. However, in the preferred embodiment there is no relative movement between the two resolution fields during the relative movement of the object of interest into the higher resolution field.

The output from the higher resolution sensor 13 is applied to a suitable object analyzer 37. One such analyzer is described in U.K. Patent Specification No. 1449501.

Thus, there is provided a method and apparatus for analyzing a scene at a low resolution until an object of interest is detected. Thereafter, the object of interest is analyzed at a higher resolution while continuing to analyze the scene at the low resolution. In the preferred embodiment, the scene comprises a blood sample and the objects of interest are blood cells.

WHAT I CLAIM IS: 1. A method for dual resolution analysis of a scene comprising the steps of searching the scene at a low resolution to detect an object therein; analysing the detected object to determine if it is an object of interest; and, analysing the object of interest at a higher resolution while continuing to search the scene at the lower resolution to detect any other objects therein.

2. A method as claimed in claim 1 wherein said continuing low resolution scanning is performed without moving the sample relative to at least one of said resolution fields.

3. A method as claimed in claim 2 further comprising the step of moving the higher resolution field relative to the sample to bring each detected object into the higher resolution field.

4. A method as claimed in claim 3 further comprising the step of moving both the low and higher resolution fields relative to the sample while maintaining the same relative position with respect to each other.

S. A dual resolution scene analysis apparatus comprising means for detecting when an object is encountered during the low resolution search; means for analysing the detected object to determine if it is an object of interest; means for analysing the object of interest at a higher resolution; means responsive to said detected object analysing means for initiating the object of

**WARNING** end of DESC field may overlap start of CLMS **.

Claims

**WARNING** start of CLMS field may overlap end of DESC **.

The preceding brief discussion of an illustrated relatively complex low resolution analyzer is directed to the data processing of a single object of interest. It will be appreciated that multiple objects of interest can be handled with suitable storage and processing capability.

It will be appreciated that when the object of interest detected by the low resolution analyzer has been moved into the field of view of the high resolution sensor, the movement also positioned a new scene in the field of view of the low resolution sensor. While the high resolution field is being scanned and analyzed by the high resolution sensor and high resolution analysis means, the low resolution field can be scanned and analyzed by the low resolution sensor and low resolution analyzer to determinc if there is another object of interest in the new low resolution field. Thus, when the detailed scan of the object in the high resolution field is complete, the X and Y registers 23 and 24 will contain the coordinates of a new object of interest if one was present in the low resolution field.This feature of the invention which allows the simultaneous or ncarly simultaneous analysis of the sample at multiple resolutions results in considerable increase in system speed ovcr a system which must perform these tasks in a sequential manner.

It should also be observed that the rela tivc position of the higher resolution field 11 with respect to the low resolution field 7 as shown in Figure 1 is only one of a number of possible positions. Figure 4 illustrates some of the possible relative positions for the two resolution fields. In Figure 4A, the higher resolution field 1 ib is shown positioned at the center of the low resolution field 7.

Other locations within the low resolution field can be employed as illustrated in Figure 4B. The higher resolution field also can partially ovcrlap the low resolution field as illustrated in Figure 4C or be located entircly outside of the low resolution field as depicted in Figure 4D. These four arrange mcnts are not intended to be exhaustivc, but should be construed as being mercly illustrated of a large number of possible arrange mcnts.

It has been mcntioned previously that it is not necessary to physically move the sample carrier 1 in order to move an object of interest into the higher resolution field.

Looking at Figure 5, the sample carrier is identified as ib and the sample as 4b. Drive motors 2b and 3b are employed to drive movable mirrors 33 and 34 which change the area of the sample 4b scanned by the high and low resolution fields without physically moving the sample. Generally, this particular configuration is practical only if the working distance of the primary optical objective 6 is sufficient to allow the mirrors to be conveniently positioned between it and the sample while maintaining relatively uniform focus.

It will be appreciated that the relative movement of higher resolution field with respect to the object of interest can be accomplished either with or without a corresponding relative movement of the low resolution field 7. In the preferred embodiment, both the low and high resolution fields are moved relative to the object of interest to bring the object of interest into the higher resolution field. However, in the preferred embodiment there is no relative movement between the two resolution fields during the relative movement of the object of interest into the higher resolution field.

The output from the higher resolution sensor 13 is applied to a suitable object analyzer 37. One such analyzer is described in U.K. Patent Specification No. 1449501.

Thus, there is provided a method and apparatus for analyzing a scene at a low resolution until an object of interest is detected. Thereafter, the object of interest is analyzed at a higher resolution while continuing to analyze the scene at the low resolution. In the preferred embodiment, the scene comprises a blood sample and the objects of interest are blood cells.

WHAT I CLAIM IS:

1. A method for dual resolution analysis of a scene comprising the steps of searching the scene at a low resolution to detect an object therein; analysing the detected object to determine if it is an object of interest; and, analysing the object of interest at a higher resolution while continuing to search the scene at the lower resolution to detect any other objects therein.

2. A method as claimed in claim 1 wherein said continuing low resolution scanning is performed without moving the sample relative to at least one of said resolution fields.

3. A method as claimed in claim 2 further comprising the step of moving the higher resolution field relative to the sample to bring each detected object into the higher resolution field.

4. A method as claimed in claim 3 further comprising the step of moving both the low and higher resolution fields relative to the sample while maintaining the same relative position with respect to each other.

S. A dual resolution scene analysis apparatus comprising means for detecting when an object is encountered during the low resolution search; means for analysing the detected object to determine if it is an object of interest; means for analysing the object of interest at a higher resolution; means responsive to said detected object analysing means for initiating the object of

interest analysis by said higher resolution analysing means while said low resolution searching means continues to search the scene to detect any other objects therein.

6. Apparatus as claimed in claim 5, wherein said low resolution scanning means have a low resolution field of view, and said high resolution scanning means have a high resolution field of view.

7. Apparatus as claimed in claim 6, wherein said means responsive to said object detection means for initiating the object scanning by said high resolution scanning means while said low resolution scanning means are operative to continue to scan the sample to detect any other objects in the sample without moving the sample relative to at least one of said resolution fields of view.

8. Apparatus as claimed in claim 7 wherein said at least one resolution field is the low resolution field.

9. Apparatus as claimed in claim 6 wherein said low resolution scanning means is operative to continue to scan the sample without moving the sample relative to the low and high resolution fields.

10. A dual resolution sample scanning apparatus comprising means for positioning a sample; a first opto-electrical image scanning means for producing an output signal when a sample object is encountered during scanning; a second opto-electrical image scanning means for producing output signals representative of a scanned image; optical means for imaging a low resolution sample field on said first opto-electrical image scanning means and a higher resolution sample field on said second opto-electrical image scanning means; means for analysing said output signal to determine if an encountered sample object is an object of interest and, if so, producing an object of interest output signal; and means responsive to the object of interest output signal for moving the higher resolution sample field relative to the sample to bring the encountered sample object into the higher resolution field for scanning by said second opto-electrical image scanning means while the first optoelectrical image scanning means continues to scan the low resolution field to detect any other objects in the sample, said continuing low resolution field scan being performed without moving the sample relative to at least one of said resolution fields.

11. Apparatus as claimed in claim 10 wherein said optical means for imaging said low and higher resolution sample fields have optical paths which have a common portion.

12. Apparatus as claimed in either of claims 10 or 11 wherein said sample positioning means includes X-Y sample support means and said output signal responsive moving means includes X and Y drive means for moving said sample support means.

13. Apparatus as claimed in claim 10 wherein said output signal responsive moving means moves both the low and higher resolution sample fields relative to the sample.

14. Apparatus as claimed in claim 13 wherein said moving means is operative to move both the low and higher resolution sample fields relative to the sample without altering the relative relationship of the two fields with respect to each other.

15. Apparatus as claimed in any one of claims 10 to 14 wherein the higher resolution sample field is positioned within the low sample resolution field.

16. Apparatus as claimed in any one of claims 10 to 14 wherein the higher sample resolution field and the low sample resolution field partially overlap.

17. Apparatus as claimed in any one of claims 10 to 14 wherein the higher resolution sample field is positioned outside of the low resolution sample field.

18. The methods for dual resolution analysis hereinbefore described with reference to the accompanying drawings.

19. Dual resolution analysis apparatus substantially as hereinbefore described with reference to the accompanying drawings.