DE4211904A1 - Ascertaining type list for liquid sample examintion - using imaging pick=up and localising appts. for recognising and locating object within registered image data to enable automatic output from identifying appts. - Google Patents

Abstract

The method includes optical detection of the sample (13) as a result of image data; identification and location of the objects (14) in the detected image data; and the automatic identifying of the located objects (14) by the automatic comparison of the respective located object, with a determined group of reference objects. The reference objects are selected from a large group of reference objects on the basis of the coarse characteristics of the located objects (14), obtained from the image data. The identified objects (14) are counted according to the respective types; and the counted objects (14) are entered in the type list (48). The system for carrying out the method includes a camera type system (16), a locating unit (40), an identifying unit (44) and a counter (46). USE/ADVANTAGE - Ecosystem investigations. Subjective analysis is excluded. Automatic identification and analysis of specimens including bacteria from 1 micron size. Cluster of objects can be examined with background taken into consideration.

Description

The invention relates to a method and an apparatus for Creation of a list of species for a liquid sample with shape and / or portable z. T. over each other opaque and overlapping objects of different types to determine the ecological condition of the sample.  

Such a manual method, however, is from practice known. It is used for the investigation of activated sludges etc. Biomass, for the determination of water quality and / or for Monitoring biological wastewater treatment systems. To this The purpose is to study the "living sludge" ecosystem, which a defined space with generally the same properties represents that in the habitat, the non-living biotope, and into the species communities or the community, the biocenosis disintegrates.

The biocenosis is composed of different species, which have very different object densities. Furthermore ranges the size of the objects, including algae, fungi, protozoa and metazoa count, from 1µm (bacteria) to several mm (Microorganisms). There are up to 100 and more per sample Object types and each type from one object to several thousand Objects.

Furthermore, not only living objects are found in the sample, but also other particles such as flakes, fibers, hair etc.

With "Art" or "Types" all objects are in the following text of the ecosystem, for example both organisms as well as flakes, hair etc.

The purpose of the investigation is to make statements about prehistory, State and likely evolution of the ecosystem to be able to do. It is also about monitoring the Operations and a "health check" of the ecosystem a biological wastewater treatment system. The in the frame Statements obtained from the investigation are used to determine the operational and chemical-physical data of To confirm and / or supplement the system or in the case of a  To initiate further investigations in the event of an accident. The data will continue to be a long-term study of the Biocenosis of the respective plant used.

As part of these investigations, it is necessary to Species list of all objects in a sample (e.g. 50 µl) create and evaluate. The creation of the species list will currently featured by staff with different educational backgrounds a microscope and possibly a CCD camera Video recorder for documentation of the samples examined ver turn.

The classification of the different objects into the different ones Object classes or types are mostly knowledge and experience matter, whereby the methods used depend on the Experience of the person in charge of the investigation is very low are different. Naturally, this is only one of them incomplete data collection possible, which is only a part represents the biomass to be examined.

The species list created in this way is used for a fort Long-term monitoring (population growth of individual species; Flake formation and age; Complexity of Biocenosis; Oxygen content based on indicator organisms; Saprobia levels as an index for water quality) in a computer entered and to recognize periodic processes already used in the early stage. The computer also carries out a Modeling the biocenosis through to the specific To determine dependencies between the species and so between normal / usual changes in the biocenosis on the one hand and on the other hand distinguish between deviations caused by the outside to be able to.  

With the examination procedure described so far Not only wastewater treatment plants checked, also natural ecosystems such as lakes, rivers, seas etc. are examined / monitored.

The creation of the species list to be carried out by humans requires not only the limiting time factor but also one undesirably high error rate. Furthermore, this is on this Amount of data obtained wisely for a comprehensive overview of the state of the ecosystem under investigation is often too great low.

For the sake of completeness, it should be mentioned here that a comprehensive chemical analysis of activated sludges is possible is, but still takes longer than that described at the beginning Determination using a man-made one Species list.

Now it is known to use fluorescence microscopes with camera systems to be used, but the samples are almost exclusively here two-dimensional and dry. Liquid samples with moving Objects can be used with such, especially in research systems to be found in laboratories cannot be examined.

Furthermore, it is known to be transported on a conveyor belt Items such as B. screws etc. with the help of a hand habitation robots to sort, with the robot over a Image processing system is controlled. The image processing system searches for desired (error-free) objects that the Robots are transported in the appropriate predefined boxes. Here So the calculator has an expectation of recovery the objects to be sorted, d. H. it's just a yes / no- Decide whether to use the object in the computer stored reference object matches. Such a thing  Image processing system therefore searches for desired objects, while it is a case of creating the species list Identify unknown objects, their location in space can be any.

In addition, the objects can be examined in the liquid samples also occur as cluster objects. Under Cluster objects become several connected objects here understood, e.g. B. can have several micro on a flake attach organisms so that a cluster object arises, the from inanimate and animate objects, possibly of different types consists. The objects of such a cluster object can also cover each other or overlap be present or even intertwined, so that initially a separation of the cluster object into the individual objects is required. As mentioned earlier, some of the Objects in the sample, d. H. the objects may be local and changeable. An object type is also in ver encountered at different stages of development, i.e. in different Sizes. It should also be borne in mind that between the Dimensions of the smallest and the largest objects almost four Orders of magnitude.

Because of the great variety of shapes of living objects not all possible appearances in the desired process forms are stored in a kind of reference database, because whose number is astronomically high.

With the known methods and systems of image processing it is not yet possible to create the species list.  

From EP-B-00 73 140 such a method and a Such device for two-dimensional examination of Template masks known for the creation of semiconductor devices. The mask to be examined is placed on an X / Y cross table and contrasted in transmitted light. A CCD camera picks up an image of this mask and passes it on to a signal processor device for generating image pattern data.

The device has a memory for the current data the mask to be examined and for predetermined image pattern data a reference mask.

To the problem of the rounded in the etching process To take corners, the reference data is right contain angled corners, modified so that comparison pictures with still permissible rounded corners for a visual Comparison or provided for automatic comparison will. The current record and the modified reference data set are fed to a comparator device for this purpose, which determines whether the measured and the specified contours match within an error threshold.

A similar method and a corresponding device are known from EP-A-01 47 205. Here is what is to be examined Pattern on a regularly recurring basic pattern that accordingly only once as a reference image pattern data record must be present.

With this procedure, the hard edges of the template data in a preselected width by subsequently introduced Gray values resolved to make a comparison within certain ones Enable error widths.  

As already mentioned at the beginning, these are known Process the measured data of the masks to be examined read in unchanged and with specified data, which may be changed, compared.

Furthermore, from DE-OS 29 03 625 a device for automati blood analysis known. The device uses a digital image and pattern recognition system with a microscope optics, whereby a sliding table and a focus control for Come into play. The blood cells to be analyzed must be here spatially separated from each other in a single-cell layer exist, with only objects in a certain size range be evaluated. Form and are additional criteria Color of the objects determined.

As with the handling robot mentioned above, too here the system has a recovery expectation regarding the sorting objects. Objects that are not in a computer Known form are present, which for example, too Have clustered together or one that is not foreseen have taken on form, are discarded as a dirt effect. Objects that change shape or even move, which may have clustered together to form larger clusters So the device cannot be analyzed.

A corresponding device for blood analysis is in the DE-OS 24 15 974 described. The known device comprises a sliding table, which is the dry one to be examined Sample moved under a microscope. There is also a television Camera provided, which the one captured by the microscope Represents part of the sample on a screen. During that The individual blood cells are started automatically an operator who needs the blood cells is required  identified and by pressing an appropriate button classified. So this procedure is the same Disadvantages like the manual process mentioned at the beginning for the investigation of activated sludge.

From DE-OS 33 13 789 is a microscopic examination direction known, in which in the investigative operation nucleated Objects found and based on a number of features, such as for example, color, size and structure can be classified. With this device, too, only objects can be classified for which there is an expectation of recovery. Furthermore, the objects to be examined must pass through a few Features identifiable from the optical data clearly identifi decorate.

This method is therefore also unsuitable Objects that can possibly be clustered in locate, identify, and identify a liquid sample classify.

Furthermore, DE-OS 38 36 716 is an interactive process described for the evaluation of cell images, in the technical trained personnel is required in order to operate the To guide and support computers in the evaluation. In order to is this method with the nightlife already mentioned at the beginning len - limiting time factor, high error rate - from manual Procedure afflicted.

For the reasons already outlined, all of these procedures are not suitable for the automatic creation of the species list.

Based on the state of the art cited so far, it is Object of the present invention, a method and Device for creating a list of species for a liquid To create a sample with which a faster and higher Data throughput is guaranteed and only a small one Error frequency occurs. The device is also intended be inexpensive to build and operate. Furthermore should with the new method and the new device also form ver changeable objects can be identified for their there is no concrete expectation of recovery, so they are not clearly predictable.

According to the invention, this object is achieved by a method of the type mentioned at the beginning with the steps:

• a) optical detection of the sample as a result of image data;
• b) Recognize and localize the objects in the detected Image data;
• c) Automatic identification of the localized objects by automatically comparing the respective localized Object with a certain group of reference objects, the due to coarse features obtained from the image data of the localized object from a larger group of Reference objects are selected;
• d) counting the identified objects according to the respective Species; and
• e) Enter the counted objects in the species list.

This object is also achieved by a device with:

• a) an image recording device for optically detecting the Sample as a result of image data;
• b) a localization device for recognition and localization ren of the objects in the captured image data;
• c) an identification device for automatic Identifying the localized objects; and
• d) a counting device for counting the identified objects according to the respective types and for entering the counted Objects in the species list, the identification being direction includes a search facility that the localized Compares objects with a group of reference objects, which is due to the coarse feature obtained from the image data paint the localized object from a larger group of reference objects, and an identified object reports as such to the counting device.

The task is completely solved in this way, because the Applicants have recognized that the main source of error and the main time factor lies in the identification of the objects. By the automatic identification with the help of an identification direction errors are largely excluded. The new The method and the new device also work much faster than the staff on their own. The Localization of the objects in the captured image data could indeed can still be done manually, but the operator can do so here work much less tired than if they also would have to identify the localized objects. Besides, is it is no longer absolutely necessary, qualified  Use specialist staff to locate objects for example on a data display device, can also be taught Forces are used.

Since the process is automated / automatable single steps can be broken down, for example, all objects be localized before the automatic identification processes run. On the other hand, it is also possible if the automatic identification device very quickly works to immediately identify each localized object.

The new device or the new method therefore works in such a way that first of all rough features of the objects from the image data are extracted, based on which then from the existing Reference objects a narrow group is selected, with which then the objects to be identified are compared. It deals a knowledge-based process, so to speak.

In a preferred development, the method is characterized by the marked further step:

• f) Automatic, interpretative evaluation of the entries in the species list using targeted methods from ecology, biology and ethology.

This measure has the advantage that the species list is not only created automatically, but also interpreted automatically is, so that with the new method without intermediary a statement about the ecological status of human beings examined sample is possible.  

In the method described so far, it is preferred if before the step of automatically identifying each localized object subjected to the following process steps becomes:

• c1) Automatic detection of the presence of one of several contiguous, possibly overlapping, with each other intertwined objects of existing cluster object;
• c2) splitting off a sub-object from the cluster object and
• c3) comparing the sub-object or the localized object with reference objects (step c from above).

The advantage here is that a cluster object that automatically is recognized, broken down into sub-objects, which are successively included be compared to the available reference objects.

Since the number of possible cluster objects that are in one liquid sample is huge, it wouldn't be possible, all possible cluster objects as reference objects to keep in stock. By breaking the cluster objects into Subobjects becomes the number of reference objects required and consequently the number of comparisons required is strong reduced. This leads to a faster expiry of the new one Procedure.

In this embodiment, it is preferred if that automatic identification which includes the further steps:

• c4) Selecting the one belonging to an identified sub-object Reference object,  
• c5) Generation of a modified cluster object by reducing the cluster object around the selected reference object and
• c6) treat the modified cluster object as a localized object.

This measure is advantageous insofar as it is split off of the sub-object is not necessarily a complete main object was split off from the cluster object. It is possible that the split off sub-object is only part of one on the cluster object hanging single object. By selecting the reference object or main object belonging to the sub-object becomes the number of splits required for a cluster object reduced. The cluster object is not just around the sub-object, but around further sub-objects of the to identified sub-object belonging main object or Refe boundary object reduced. Contains the modified cluster object so possibly significantly fewer sub-objects than if only that previously addressed sub-object has been subtracted from the cluster object would.

Here it is further preferred if the automatic detection the presence of a cluster object comprises the steps:

• c1a) Determination of a length / maximum extent of the localized Object,
• c1b) Determination of the widths of the localized object and
• c1c) Assessment of the deviations of the widths among each other as well as the location of the latitudes to the longitude to the presence to determine a cluster object.

The advantage of these measures is that they are purely geometric Information, namely the length and the taken transversely to the length Widths can be recognized whether an object or a cluster object is present. The widths of a cluster object are different very different from each other, for example, long, thin objects and spherical objects are connected to each other. Furthermore, there are arbitrary geometric objects in cluster objects Take shape at least some of the latitudes '' outside '' the Length, d. H. the cluster object is so tortuous that the Length partially outside the outline of the cluster object runs.

In a development of the method, it is preferred if the step of recognizing and locating the objects automatic transfer of an object into a drawing file and then the automatic detection of self-contained Outlines include.

This measure has the advantage that the transfer of an object in a drawing file first to be further ver working data are reduced, it does not have to be the whole Image, but only the one or more objects Drawing file can be processed further.

It is further preferred if the step of optical detection automatic recording of image fields under the sample includes different magnifications, depending on the sample Image fields spread over their volume will.

In this advantageous manner, the sample can be added successively various magnification factors sampled or scanned be localized so that depending on the size of the  the objects the entire volume of the sample with a certain Number of image fields can be completely captured. Because of this Scanning is done automatically, the manual through looking for a liquid sample of common mistakes - it certain areas of the sample are "forgotten" - avoided. The sample is also made with all the necessary magnifications factors searched. Because of the almost four orders of magnitude sweeping different sizes of each object this leads to a high volume of data. Through the automati Process is ensured that all data is recorded and processed.

It should be mentioned here that under "Image fields" a compilation or summary of "image data" is understood that one play back a specific section of the sample. With "image fields" it is consequently "related" image data.

In this method, it is further preferred if the step of localizing the merging of several image fields, via which extends an object to form an overlay image.

This advantageous and simple measure makes objects, the size of which is such that it extends over several image fields extend, yet localized as an object and can be in assigned a reference object to a single comparison process will.

In a development of the method, it is preferred if the step of recognizing and locating the objects Detection of areas of the same or similar real color, True color samples or real color areas.  

This measure is advantageous in that it is in the image data typical colors for flakes, algae, threads etc. as well as for the Background there. In this way, for example algae that appear green or yellowish recognizing flakes from the always different colored background be distinguished.

It is further preferred if the comparison between object or search object on the one hand and reference object on the other the basis of three-dimensional virtual vector graphics he follows.

The quasi-optical virtual comparison is compared the pure comparison of extracted rough features is the advantage achieved that features are also included in the identification can be, which is not in the form of, for example Have algorithms laid down. So the reference objects Show very fine structures, on the basis of which an easy identification grace the search objects is possible while splitting of these very fine structures in characteristics that a binary Ent divorce tree would not be possible.

In this embodiment it is further preferred if the step of automatically recognizing a cluster object the disassembly of the cluster object into different areas True colors, real color areas and / or true color contrasts.

This measure is advantageous in that a cluster object always in areas of different colors and color contrasts can split. This way it is possible to get out of the Image data additional - relating to physical quantities - To gain statements about a cluster object that is a decomposition enable in subobjects.  

It is also preferred here if the cluster object is in Areas of different movement, geometric shape and / or Size is disassembled.

These criteria also advantageously enable one automatic detection of sub-objects in a cluster object.

With regard to the new device, it is preferred if they automatically interpret an evaluation device the assessment of the entry in the species list using Targeted methods from ecology, biology and ethology includes.

This measure has the advantage already mentioned that the evaluation of the list of species as a possible source of error is turned off.

It is further preferred here if the search device has a includes virtual-optical comparator for comparison between object and reference object based on three dimensions Virtual vector graphic representations is provided.

This measure has the advantage that the quasi-optical Comparison of three-dimensional representations it allows To take into account the finest structures that are not ver Have comparable individual features extracted from the image data.

Furthermore, it is preferred if the identification device a cluster decomposition device for recognizing from several contiguous, possibly overlapping or ver braided objects existing cluster objects and for disassembly  the cluster objects into sub-objects, the clusterzer in the presence of a cluster object from its subobjects to the search facility.

The advantage here is that with the new device also such Samples can be examined in which objects are too Have clustered objects together. Furthermore from Advantage that not all of the reference objects are in stock possible cluster objects must exist, but that a cluster object is broken down into smaller sub-objects, which yourself into the specified number of references with little effort arrange objects. In general, it is even the case that the sub-object is a single reference object or main object or at least an essential part of a main object, so that the specified reference objects are also immediately available Processing samples can be used in which Cluster objects.

In a further development it is preferred if the clusterzer a cluster recognition device for recognition of a cluster object and a device that a Sub-object in a cluster object recognizes the sub-object of splits off the cluster object and feeds it to the search facility.

This measure is particularly advantageous in terms of construction because the cluster decomposition device, so to speak, from two assemblies can be built.

It is further preferred if the cluster decomposition device has a virtually optical working difference generator, which  from the cluster object to an identified sub-object subtracts listening reference object and thus a modified cluster generates object, which is fed to the cluster recognition device becomes.

This advantageous measure enables the successive or iterative "processing" of a cluster object. First of all a sub-object is recognized and then that becomes the sub-object main object that can have more features than the sub-object itself, subtracted from the cluster object, so that the cluster object not only around the sub-object but also around others, sub-objects not yet compared is reduced. To this Way not every single sub-object of the cluster object be compared with the reference objects so that the Bear processing time for a cluster object is significantly reduced.

It is further preferred if the cluster recognition device a device for determining a length of the object or Cluster object and has a device for Determination of the widths of the transverse to the length Object or cluster object is provided, and if further a qualification facility is provided which is based on Deviations of the widths from each other and based on the position of the Latitude to Longitude detects whether the localized object is a Is cluster object.

This simple and advantageous way is based on purely geometrical data decided whether a cluster object is present. The length determination is nothing more than hitting of a radius around the entire object, while the latitude if necessary after a corresponding coordinate transformation a pure difference between two points represents the outline of the object. As mentioned above,  cluster objects differ from individual objects in that that the latitudes vary widely and that the cluster also is irregularly shaped so that the "length" at least in some areas, so to speak, "outside" the outline of the Cluster object lies.

It is further preferred if the cluster detection device has a device based on movement processes in partial areas and / or related areas same color detects whether the localized object is a cluster object is.

It is advantageous here that internal movement processes in the Cluster object, for example made of flakes and movable Microorganisms can exist, used for cluster detection will. This can also include areas of the same or similar color be used because the flakes and various microorganisms nisms regularly show different colors in the image data on. The flakes are often yellowish, while e.g. B. algae mostly appear greenish.

It is further preferred if the localization device has a Has outline detector, the closed in the image data Areas of the same true color areas are detected as an object recognizes and localizes and then self-contained outlines determined.

This measure is advantageous in that both objects as well as cluster objects in the image data always one in itself have a closed outline. So here it is also based simple geometric operations possible, an object or  Localize cluster object. In addition, the Color information is used to keep objects in front of the locate different colored background.

In this embodiment it is further preferred if the image capturing device includes an image capturing system adjustable optical enlarger and a Has traversing device through which the sample is relative is movable to the enlarger, such that by means of the image acquisition system of the sample over its volume distributes image fields with different magnifications positions are recordable.

With this measure, the sample is completely scanned, depending on the selected magnification, the number of image fields, which is required to make up the entire volume of the sample represent, varies. Because of the possibility of different Choosing magnification settings can be both very small Objects such as B. bacteria (1 µm) as well as very large objects can be detected with dimensions of several mm.

In this embodiment, it is preferred if the loci Siereinrichtung has a device that is based on the the outline detector in the image fields for an object that extends over several image fields Overlay image created.

This measure is simple and advantageous achieved that even with objects that are themselves over several Image fields extend, and therefore several times with reference objects should be compared, a one-time comparison with those for Available reference objects is sufficient. this leads to a faster process when creating the species list.  

It is further preferred if the localization device has a Has motion detector based on the detected outlines and / or the overlay image recognizes whether the localized Object shape and / or is changeable.

This measure is advantageous in that it is based on already available information, namely the detected outlines and the overlay image, on a mobility of the local object is closed. This information can then when splitting off sub-objects and when narrowing down the reference objects to be searched can be used.

It is also advantageous if the search device has a Comparator device which, depending on Output signals from evaluation units for true color, movement, Size and geometric form / changeability of the iden tifying object or subobject a selected part of the reference objects specified in a reference object memory searches for the object / sub-object in a virtual-optical manner.

The user has recognized that the occurring in a sample objects by an appropriate combination of the criteria Color, movement, size and geometric shape in certain groups Allow division so that when these criteria are met the The number of reference objects to be searched is severely restricted can be. This also leads to a faster process the creation of the species list.

In this embodiment it is further preferred if the device for recognizing and splitting off sub-objects Cluster object in areas of different true colors and / or True color contrasts broken down and these areas treated as sub-objects delt.  

This measure is advantageous in that based on already available physical or geometric data which areas of a cluster object are subobjects. It is therefore only necessary to add the image fields with ent speaking color contrast resolution so that from the with the image acquisition system, a decomposition of Cluster objects in subobjects is possible.

Here it is further preferred if the device for recognition and splitting off subobjects into cluster objects different mobility, shape and / or size disassembled and treated these areas as objects.

In this respect, like the previous measure, it is also of Advantage as already determined sizes and parameters for Disassembly of the cluster object can be used. These Disassembly is simple, for example, hardware scarf lines or microprogram control units possible, so that here too Time is saved.

Furthermore, it is with the new process and with the new Device preferred if for storing the reference objects a reference object memory is provided, in which the Reference objects in the form of virtual-optical three-dimensional Vector area graphic objects are stored.

With this measure, it is advantageous that the reference objects a form changeability can be added, so to speak. In the context of a vector graphic it is namely possible to individual reference objects so that certain Degrees of freedom can be provided. The reference object must therefore only be provided in a basic form, which is can change within the permissible degrees of freedom. Thereby,  that the comparison takes place on a virtual-optical level, can first search object and reference object by appropriate mathematical operations in greatest possible agreement to be brought. Then the reference object, the corresponding degrees of freedom are added with regard to changed the search object until it turns out that it can be adapted to the search object or not. To this Objects can also be identified in this way for which none There is an expectation of recovery, the concrete form of which is the reference data storage only as a possibility, but not immediately available, saved. It should be mentioned that the comparison is carried out such that the search ob ject and the reference object representing various Vectors are compared by amount and orientation and that, for example, if there is a match in 90% of the compared vectors from the affiliation of the search object to the species represented by the reference object found is going out.

It is understood that the above and the following standing features to be explained not only in each specified combination, but also in other combinations and can be used alone, without the scope of the to leave the present invention.

The invention is illustrated in the drawing and is in the following description explained in more detail. Show it:

Figure 1 shows the new device for performing the new method, in a schematic overall view.

FIG. 2 shows the control and evaluation unit of the device according to FIG. 1 in a basic circuit diagram;

Figure 3 is a with the apparatus of Figure 1 to be examined sample with schematically shown objects..;

FIG. 4 shows a series of image fields of the sample according to FIG. 3 recorded with the image recording device according to FIG. 1;

Fig. 5, the locating means of the control and evaluation unit according to Figure 2, in a schematic block diagram.

FIG. 6 is a more detailed representation of an image field of the sample of Figure 3, with a number of objects.

FIG. 7 shows the identification device of the control and evaluation unit according to FIG. 2 in a schematic block diagram;

FIG. 8 shows one of the cluster objects from the image field according to FIG. 6 in a simplified representation;

FIG. 9 shows the cluster detection device of the identification device according to FIG. 7, in a schematic block diagram; and

FIG. 10 the search device of the identification device according to FIG. 7, in a schematic block diagram.

Fig. 1 a, generally designated 10 shows apparatus for creating a list of species for between a slide 11 and a cover glass 12 contained liquid sample 13. The sample 13 may have objects 14 a, 14 b of different types that are variable in shape and / or location. The device 10 and the method to be carried out with it are used to draw up a list of species and thus to determine the ecological condition of the sample 13 , which can be taken, for example, from a sewage treatment plant or from natural water.

There is often a separate one for limnological examination Sampling required for microorganisms such as worms, insects or snails (order of magnitude mm to cm) and under to be able to search. Such samples are also liquid not on a slide, but in a petri shell or a watch glass.

The sample rooms to be examined are therefore liquid and generally optically transparent. Because of the high variability of the shape of the different objects 14 on the one hand and the fact that the objects 14 are not always isolated, but can overlap, overlap and interweave with one another, on the other hand, the device 10 often has no recoverers compared to the object 14 in the concrete form maintenance, it is so "not known" to her. The method to be carried out on the device 10 is therefore knowledge-based and self-adapting.

The device 10 has an image recording device 16 , which includes an image recording system 17 and an adjustable optical magnification device 18 . Furthermore, a driving device 19 is indicated, via which the sample 13 can be moved relative to the enlarging device 18 . This method takes place in at least two of the three axes X, Y and Z of a coordinate system indicated at 20 .

In the exemplary embodiment shown, the moving device 19 is a cross table 22 , which can be moved in the X / Y plane and possibly has a lifting device for changing its Z coordinate.

The magnification device 18 comprises a microscope 23 , which can set various magnification factors. By correspondingly focusing the microscope 23 , the Z plane, which is captured by the image recording system 17 designed as a CCD camera 24 , can also be set or changed.

In a limnological examination of microorganisms, a stereo magnifying glass (not shown in the drawing) is used instead of the microscope 23 , to which a CCD camera 24 is also connected. Depending on the size of the objects to be examined, an image recording device without an upstream magnification device can also be used.

Furthermore, a control and evaluation unit 26 is provided, which is connected to the CCD camera 24 via a data line 27 and a control line 28 . In this way, image data is recorded and transmitted to the control and evaluation unit 26 in a controlled manner. The CCD camera 24 is also connected via a white data line 29 to a mass storage device 31 , which is, for example, a video recorder and is used for video archiving of the examined sample. The mass storage device 31 is likewise connected to the control and evaluation unit 26 via a data line 32 , which can thus query the image data either directly from the CCD camera 24 or from the mass storage device 31 .

A data terminal / terminal 34 is connected to the control and evaluation unit 26 via a connecting line 33 in order to display image data of the sample 13 to a user and to give him the opportunity to intervene in the evaluation process.

Furthermore, two control lines 35 and 36 are indicated by dashed lines, via which the control and evaluation unit 26 controls the cross table 22 and the microscope 23 .

With the device described so far, the sample 13 is successively scanned (scanned) in the X, Y and Z directions, so that three-dimensional image data are available at the end of the scanning process. As mentioned, some of the objects 14 are movable, so that additional information on the time axis can also be obtained by scanning again. The quality of the images is essentially determined by the lens of the microscope 23 and by the resolution / digitization of the captured image. The adjustable magnification of the microscope 23 enables objects 14 of various sizes to be detected. The image data represent real images. Likewise, it is possible to subject the sample 13 to a fluorescence examination by irradiating it with a light source not shown in FIG. 1, this excitation light being filtered out again by a corresponding filter in the microscope 23 .

The captured image data is evaluated in the control and evaluation unit 26 shown in more detail in FIG. 2. Via the data lines 27 and 32 , image data are loaded either directly from the CCD camera 24 or from the mass storage device 31 into an image data storage device 38 . Via its output line 39 , the image data arrive in a localization device 40 , which "perceives" the objects contained in the images in a manner to be described in more detail, ie recognizes and localizes them. The objects located in this way are transferred via an object data line 41 to an object data memory 42 , from which they arrive via their output line 43 to an identification device 44 .

The identification device identifies the localized object pending in the object data memory 42 , ie it determines its type by associating the object 14 as a member with a corresponding type in a reference object memory to be described. The identification device 44 is connected via an object output line 45 to a counting device 46 , which counts the identified objects and enters a species list indicated at 48 via a transfer line 47 .

Furthermore, an evaluation device 49 is indicated in FIG. 2, which carries out an automatic evaluation or interpretation of the data entered in the species list 48 using target-oriented methods from ecology, biology and / or etology. On the basis of the interpretation of the species list 48, the evaluation device 49 provides statements about the ecological condition and, if necessary, a prognosis about the development of the sample 13 under investigation.

The device 10 described so far and the method to be carried out on it are now to be explained in more detail with reference to FIGS. 3 to 10:

In Fig. 3, the sample 13 of FIG. 1 is shown in an enlarged scale. By imaginary dividing lines 50 , the sample 13 is divided into a grid of image fields 51 , which are scanned in succession by the image recording device 16 from FIG. 1. For this purpose, the cross table 22 is moved to a specific X / Y coordinate and then image fields 51 of a stack 52 lying one above the other in the Z direction are captured, digitized and transmitted as image data to the data lines 27 , 29 by the CCD camera 24 . The size of the individual image fields 51 depends on the magnification factor to which the microscope 23 is set. The distance between two superimposed image fields 51 a, 51 d is determined by the depth of field of the microscope; namely, the smaller its depth of field, the more image fields 51 in a stack 52 have to be captured in order to scan the entire thickness of the sample 13 .

When a stack 52 has been “processed” in this way, the cross table 22 moves either in the X or Y direction by the width / length of an image field and the successive movement in the Z direction begins again. In this way, the sample 13 is scanned in a meandering manner, so to speak. Of course, it is also possible not to arrange the image fields 51 in different Z planes in the form of a stack 52 , but to offset them by a small amount in each case, so that a zigzag travel line is created over all. Compared to meandering scanning, fewer travel steps then have to be undertaken to scan the entire sample 13 .

Of course, a sample 13 is scanned again for different magnification factors of the microscope 23 . In this way, first the large objects 14 with a low magnification factor and then with increasing magnification ever smaller objects 14 are recognized, localized and identified so that they can be entered in the species list 48 .

In Fig. 3 it can be seen that the objects 14 can take any positions in space, so that they can extend over several image fields 51 .

As can be seen in FIG. 4, an object 14 , which extends in a stack 52 over a plurality of image fields 51 c, 51 d and 51 e lying one above the other, produces a different pattern 14 ′, 14 ′ ′ and 14 in each image field 51 '''. In order to be able to identify the object 14 , it is first necessary to decide how many image fields 51 an object 14 extends over. In the example shown in FIG. 4, the object 14 extends over the image fields 51 c- 51 e. Due to the depth of field of the microscope 23 , certain sections of the object 14 are sharply depicted in the plane of the image field 51 , as indicated by solid lines in FIG. 4, while other sections of the object 14 can only be seen as blurred. This is indicated in Fig. 4 by dashed lines.

In order to be able to position the individual image fields one above the other in the correct position, the image fields 51 must first be rotated and shifted in the X, Y and / or Z direction in order to take into account the movement of the object 14 in question. In order to recognize whether it is an object 14 in different image fields 51 a, 51 e that has moved further between the exposures of the successive image fields 51 , or whether different objects 14 , 14 b are being viewed, additional information can be used which originate from image data obtained with a lower magnification factor of the image recording system. At a lower magnification factor, that is, at a different depth of field, it is easier to distinguish whether there are two objects 14 b, 14 lying one above the other or a single, moving object 14 . With this superimposition of the individual image fields 51 , information falls off, so to speak, as to whether it is a moving object 14 .

Since a certain period of time elapses between the individual images of the images 51 c- 51 e, the object 14 may have moved in the meantime, but this can be recognized and compensated for on the basis of the deviation between sharp contours and blurred contours in different Z planes. A further stack image of the object 14 b is indicated at 53 b.

If the individual image fields 51 c- 51 e are positioned one above the other in the correct position, a stack image 53 is obtained which shows a kind of contour line image 54 of the object 14 . This stack image 53 means that the objects 14 are now in the form of three-dimensional image data, so that they can be recognized in the localization device 40 and identified in the automatic identification device 44 . To do this, they are stored as vector graphic objects.

Of course, the objects not only extend through a plurality of image fields 51 in the Z direction, it is quite possible, in the same way, as shown in FIG. 4 for the Z direction, in the X and / or Y direction Recognize an object 14 .

In Fig. 5 the competent locator 40 is shown in detail profiled. The data of the individual image fields 51 which are present one after the other on the output line 39 first reach an outline detector 56 which searches the image data for self-contained outlines and / or areas of the same color, and thus to the sharp (solid) contours in the image fields 51 a- 51 b from FIG. 4 comes. This takes advantage of the fact that the objects 14 are always of a different color than the background, which means that they differ from the background not only by the contrast but also by the coloring. In addition, the outline detector 56 detects the blurred outlines of the objects 14 .

For this purpose, the outline detector 56 places an overlay window over the respective objects as follows: First, point by point of each image field 51 is queried as to whether its true color belongs to the background color area or stands out from it. If an image point (pixel) is found that does not belong to the background, so that it is part of an object 14 , then this point is covered by a virtual square window. The edges of the window are now iteratively shifted away from each other in all four coordinate directions until the edges are only over pixels that can be assigned to the background color range. Since the starting pixel was an object pixel, this ensures that at least one object is delimited in the overlay window generated in this way.

The object 14 thus delimited is copied into a partial image, so that the data to be processed further have been significantly reduced. After copying, the object (the objects) recognized in the original image data set is "deleted" by converting the recognized object pixels into background pixels. The original image data thus only contain "non-perceived" objects that are recognized and copied in the same way.

While moving the overlay window edges, the outline detector 56 has simultaneously marked each object pixel as such and additionally recognized pixels belonging to the outline of the respective object 14 in the following manner: Each pixel which is connected to a pixel on at least one of its four sides bordered with background color, "belongs" to the outline of the object, while pixels surrounded on all sides by object pixels are "inside" the object. The method just described also ensures that each edge of the overlay window adjoins the enclosed object at least at one point.

After the individual objects in the different image fields 51 have been recognized in this way, the reduced data arrive in a stack image overlay 57 which , as already described with reference to FIG. 4, superimposes the individual image fields 51 so that the blurred and the sharp contours agree under different image fields 51 . The individual stack images 51 a- 51 e, which are aligned with one another in this way, are stored in the object locator 58 as three-dimensional vector graphic representations. From here, the data arrive in a motion detector 59 which , on the basis of the displacement of the individual image fields 51 that was necessary in order to arrive at an object 14 , determines whether the object in question is a moving object. Via the output lines 60 and 61 , the data of the stacked image 53 and the movement information are fed to a logic circuit 62 , which gives this data to the object data memory 42 via the object data line 41 .

In FIG. 6, the projection of a stack image 53 generated by the locator 40 is shown fragmentary, such as is typically found an activated sludge for a sample 13. The stacked image 53 shows a small flake 64 , a protozoan 65 and a filamentous bacteria 66 with an additional bacterial growth 67 . Furthermore, a large flake 68 can be seen on which another thread bacterium 69 is seated. Furthermore, Fig. 6 has a colony of three bell animals 70 a, 70 b, 70 c, which have a common stem 71 , which sits with its base 72 on the large flake 68 . While the objects 64 and 65 are individual objects that can be easily identified in the identification device 44 , the objects 66 , 67 and 68 , 69 , 70 , 71 represent a cluster object 73 a, 73. The number of possible cluster objects is so astro nomically high that it is not possible to generate reference data objects for these cluster objects. The identification device 44 must therefore be able to process any cluster object 73 so that it can be uniquely identified with a limited number of given reference data. It should also be borne in mind here that the sub-objects of a cluster object 73 can at least partially overlap or overlap one another and may also be interwoven with one another.

In Fig. 7 it is shown that the identification device 44 comprises for this reason, a cluster decomposing means 74 as well as an object detection device 75. The data of a localized object is sent via the output line 43 to a cluster recognition device 76 , which checks each newly pending object to determine whether it is an individual object or a cluster object 73 . How this happens will be explained later.

If the object pending on the output line 43 is a single object, the cluster recognition device 76 transmits the data via its output line 77 to a comparison memory 78 of the object recognition device 75 . If, on the other hand, it is a cluster object 73 , the data is loaded into a cluster memory 80 by the cluster recognition device 76 via its output line 79 . From the cluster memory 80 , the data passes via a cluster data line 81 to a sub-object recognition device 82 , which breaks down a cluster object 73 into a number of sub-objects. This breakdown into sub-objects is based on further data that, for example, make statements about the geometric shape of certain areas of the cluster. Furthermore, the colors of the cluster areas and / or the different contrasts are used to break down the cluster object 73 shown in FIG. 6 into individual subobjects. Returning to FIG. 6, it can be seen that, for example, the bell animals 70 and their stems 71 are hatched differently, which indicates a different color. The sub-object recognition device 82 now splits off the bell animal 70 a from the cluster 73 and transmits the data of the bell animal 70 a via a sub-object data line 83 to the comparison memory 78 .

The comparison memory 78 now contains either the data of a single object 14 or the data of a sub-object. This data, referred to as “search object”, reaches a search device 85 via a search object data line 84 , which in turn is connected to a reference data memory 87 via a reference object data line 86 . The reference data memory 87 contains a vector, three-dimensional representation of all objects 14 that can occur in a sample 13 .

Since many of the objects 14 are changeable in shape, that is to say have a different geometric shape, for example, when they are resting or moving, this must be taken into account in the reference object data. However, the number of possible shapes that a single movable object 14 can take is so great that they cannot all be predicted and saved. For this reason, the reference data memory 87 is constructed in such a way that the reference objects are stored in one or more basic geometric shapes. In addition to this basic shape, degrees of freedom are stored, which take into account the possible and permissible movements and changes in shape of the respective object. When comparing the search object and the various reference objects, the reference objects are now changed with regard to the search object (within the scope of their permissible degrees of freedom) until they either "match" the search object or until it is found that no match can be achieved. This comparison is a virtual-optical process in which, based on a knowledge-based method (the permissible degrees of freedom of a reference object are saved), the vector graphic representation of an object / sub-object is compared with a two-dimensional projection of a virtual three-dimensional vector surface graphic model of the respective reference object to be compared.

The search device 85 thus now compares the data that are present on the search object data line 84 with the existing data of the reference data memory 87 until the reference object that matches the search object is found. When splitting off in the sub-object recognition device 82 , it can now happen that not an entire object 14 is split off from the cluster 73 , but only a partial object. In the example of FIG. 6, an animal consisting of stem 71 a and bell part 70 a is not split off, but only partial object 70 a.

In the reference data memory 87, however, is to the part of object 70 a a primary object 14 consisting of a portion of object 70 and object portion 71 a. This main object is now passed via a main object data line 88 to a virtual optical difference generator 89 , which is also connected to the cluster memory 80 via a line 90 . The difference former 89 now modifies the cluster object originally located in the cluster memory 80 in such a way that it is reduced by the already recognized main object.

The modified cluster object is returned via line 91 to the cluster recognition device 76 , where the image data now pending are either recognized again as a cluster and are written into the cluster memory 80 , or are recognized as a single object and are therefore directly transferred to the comparison memory 78 .

Of course, each recognized main object is reported to the counting device 46 via the object output line 45 .

It should be mentioned here that the reference objects present in the reference data memory 87 are expanded on a case-by-case basis by further newly occurring or newly determined objects, the device 10 is therefore self-adapting.

Referring to Fig. 8 will now be described, according to which criteria the cluster recognizer 76 determines whether it is in the forthcoming on the data output line 43 to a single object 14 or a cluster object 73rd

For the sake of clarity, the bell animals 70 b and 70 c from FIG. 6 have been omitted in FIG. 8. The colors and the contrast of the individual elements of the cluster 73 'from Fig. 8 also play no role in this example for the detection of whether it is a cluster. The cluster object 73 is represented in FIG. 8 only by its outline indicated at 92. This outline of the cluster object 73 has already been averaged with the aid of the outline detector 56 - see FIG. 5.

The cluster recognition device 76 now places a radius around the cluster object and thus determines its length, indicated at 93, its maximum extent in the X / Y plane. This is done, for example, by determining the distance between all coordinate pairs (X / Y) and then recording the maximum distance as length 93 in the image data.

Next, the width of the cluster object 73 or the object 14 is determined perpendicular to the length 93 . This is also done by determining the distance between the corresponding coordinates, some widths are indicated at 94 a, 94 b in Fig. 8. It can be seen that the cluster object 73 partially has widths 94 c that do not have an intersection with the length 93 . This is an indication of an irregular shape of the object 14 or the cluster object 73 . According to criteria to be determined in each case, the cluster detection device 76 determines from the variation of the different widths 94 a- 94 c and from the fact how often the length 93 lies "outside" of the object 14 or the cluster object 73 , whether it is the present data record is a cluster object 73 .

The cluster recognition device 76 is shown in more detail in FIG. 9. The object data of a localized object pending on the output line 43 are fed to individual assemblies of the cluster detection device 76 via an inner data branch 95 . Via a switch 96 , either the output line 43 , which comes from the object data memory 42 , or the line 91 , which contains information of a modified cluster object 73 , is switched to the internal data branch 95 .

These data arrive in a device 97 for determining the length, a device 98 for determining the width and a qualification device 99 , the z. B. determined from the ratio of length to width whether the object 14 to be evaluated is a single object 14 or a cluster object 73 . The operation of the devices 97 , 98 and the qualification device 99 has already been explained with reference to FIG. 8.

The qualification device 99 outputs the pending data either to the output line 77 if it is a single object 14 , or to the output line 79 if it is a cluster object 73 .

The cluster recognition device 76 furthermore has a device 100 which recognizes on the basis of movement processes in partial areas of a cluster and / or of contiguous areas of the same true colors whether the localized object 14 is a cluster object 73 .

Finally, it will be explained how the search device 85 compares the search objects pending on the search object data line 84 with the reference data of the reference data memory 87 accessible on the reference data line 86 . This is done using FIG. 10.

For this purpose, the search device 85 has a virtually optically operating comparator device 101 , which successively queries the available data of the reference data memory 87 and compares it with the search object data on the search object data line 84 . So that not all reference objects have to be screened for each search object, the search device 85 comprises, for example, four evaluation units 102 , 103 , 104 and 105 which qualify the search objects according to color, movement, size and geometric shape or changeability in shape. This information leads to decision criteria that enable the comparator device 101 to actually compare only a small set of the total available reference objects with the respective search object.

If, for example, the longest dimension of the search object is less than two μm, only the bacteria stored in the reference data memory 87 are compared with the search object. If, on the other hand, the search object has an unusual, rare coloring, only the reference objects identified with the corresponding color code are compared with the search object. Corresponding considerations can also be made for movement and geometric shape.

Depending on which of the four criteria color, movement, size and geometric shape that is shown here as an example proves to be the most relevant, the comparator device 101 searches certain areas of the reference data memory 87 . In this way, a much faster identification of the object and, in a recursive manner, of a cluster 73 can be carried out.

The evaluation devices 102-105 represent a feature set comparator , so to speak, which performs a type of morphological classification of the objects on the basis of features extracted from the image data. Because of the great diversity of shapes of the individual objects of the same type, such a morphological classification is only possible to a certain extent due to rough painting. Then, as already described above, a quasi-visual comparison takes place in the comparator device 101 , a comparison based on virtual three-dimensional vector graphics. The vectors of the search and reference object are compared with one another in terms of magnitude (length) and solid angle (orientation in space). The reference objects are designed to change their shape, so they are changed with regard to the respective search object until they "fit". In this way, all features that cannot be easily described can still be taken into account, since they are implemented in the very fine structure of the reference object. A complete object identification based on descriptive features is also not possible because the different types differ from each other in part by sets of features that are difficult to capture in algorithms, be it at the hardware or software level.

If the search object has been recognized as part of a main object, the corresponding main object is loaded by the comparator 101 into a main object memory 106 which is connected to the difference former 89 via the main object data line 88 .

For the sake of completeness, it should finally be mentioned that the various modules indicated in FIGS . 2, 4, 5, 7, 9 and 10 by rectangular boxes in any combination wholly or partly either by pure hardware circuits / microprogram control units, Arithmetic circuits or program-controlled data processing units can be implemented. Furthermore, it goes without saying that the individual memories can either be separate memories or can be partially overlapping areas of a single memory.

Claims (28)

1. The method for creating a list of species ( 48 ) for a liquid sample ( 13 ) with any shape and / or location changes zichen z. T. mutually overlapping or overlapping objects of different types for determining the ecological condition of the sample ( 13 ), with the steps:

• a) optical detection of the sample ( 13 ) as a result of image data;
• b) recognizing and locating the objects ( 14 ) in the captured image data;
• c) Automatic identification of the localized objects ( 14 ) by automatically comparing the respective localized object ( 14 ) with a specific group of reference objects, which are selected from a larger group of reference objects on the basis of coarse features of the localized object ( 14 ) obtained from the image data will;
• d) counting the identified objects ( 14 ) according to the respective types; and
• e) Entering the counted objects ( 14 ) in the species list ( 48 ).

2. The method according to claim 1, characterized by the further step:

• f) Automatic, interpretative evaluation of the entries in the species list using target-oriented methods from ecology, biology and ethology.

3. The method according to claim 1 or 2, characterized in that before the step of automatically identifying the localized object is subjected to the following process steps:

• c1) automatic detection of the presence of a cluster object ( 73 ) consisting of several connected, possibly overlapping, interwoven objects ( 14 );
• c2) splitting off a sub-object from the cluster object ( 73 ); and
• c3) comparing the sub-object or the localized object with reference objects (step c) from claim 1).

4. The method according to claim 3, characterized in that the automatic identification comprises the further steps:

• c4) selecting the reference object belonging to an identified sub-object;
• c5) generating a modified cluster object ( 73 ) by reducing the cluster object ( 73 ) by the selected reference object; and
• c6) treating the modified cluster object ( 73 ) as a localized object ( 14 ) (step c1).

5. The method according to any one of claims 3 or 4, characterized in that the automatic detection of the presence of a cluster object ( 73 ) comprises the steps:

• c1a) determining a length ( 73 ) or maximum extent of the localized object ( 14 );
• c1b) determination of widths ( 94 ) of the localized object ( 14 ) running transversely to the length ( 93 ); and
• c1c) Evaluating the deviations of the widths ( 94 a, 94 b, 94 c) from one another and the position of the widths ( 94 ) relative to the length ( 93 ) in order to determine the presence of a cluster object ( 73 ).

6. The method according to any one of claims 1 to 5, characterized in that the step of recognizing and locating the objects ( 14 ) the automatic transfer of an object ( 14 ) into a partial image and then the automatic detection of self-contained outlines ( 92 ) includes. 7. The method according to any one of claims 1 to 6, characterized in that the step of optically detecting the sample ( 13 ) comprises the automatic recording of image fields ( 51 ) of different magnifications, each of the sample ( 13 ) distributed over their volume over their magnification Image fields ( 51 ) are recorded. 8. The method according to claims 6 and 7, characterized in that the step of locating the merging of several image fields ( 51 ) over which an object ( 14 ) extends to an overlay image ( 53 ). 9. The method according to any one of claims 1 to 8, characterized in that the step of locating the objects ( 14 ) comprises detecting areas of the same or similar real color, real color pattern or real color areas. 10. The method according to any one of claims 1 to 9, characterized characterized in that the comparison between object or Subobject on the one hand and reference object on the other the basis of three-dimensional virtual vector graphics positions. 11. The method according to any one of claims 3 to 10, characterized in that the automatic detection of a cluster object ( 73 ) comprises the decomposition of the cluster object ( 73 ) into areas of different true colors, true color patterns and / or true color contrasts. 12. The method according to claim 11, characterized in that the cluster object in areas of different movement, geometric shape and size is broken down.   13. Apparatus for creating a list of species ( 48 ) for a liquid sample ( 13 ) with any shape and / or location changes, z. T. mutually overlapping or overlapping objects ( 14 ) of different types for determining the ecological condition of the sample ( 13 ), with:

• a) an image recording device ( 16 ) for optically capturing the sample ( 13 ) as a result of image data;
• b) a locating device ( 40 ) for recognizing and locating the objects ( 14 ) in the captured image data;
• c) an identification device ( 44 ) for automatically identifying the localized objects ( 14 ); and
• d) a counting device ( 46 ) for counting the identified objects ( 14 ) according to the respective species and for entering the counted objects ( 14 ) in the list of species ( 48 ), the identification device ( 44 ) comprising a search device ( 85 ), which compares the localized objects ( 14 ) with a group of reference objects which result from a larger group of reference objects on the basis of coarse features of the localized object ( 14 ) obtained from the image data, and an identified object ( 14 ) as such to the counting device ( 46 ) reports.

14. The apparatus according to claim 13, characterized in that it comprises an evaluation device ( 49 ) for automatic, interpretive evaluation of the entry in the species list ( 48 ) using target-oriented methods from ecology, biology and ethology. 15. Device according to one of claims 13 or 14, characterized in that the search device ( 85 ) comprises a virtual optical comparator ( 101 ) for the comparison between object and reference object on the basis of three-dimensional virtual vector graphic representations. 16. The apparatus according to claim 13 to 15, characterized in that the identification device ( 44 ) a cluster decomposition device ( 74 ) for recognizing from several connected, possibly overlapping or intertwined objects ( 14 ) existing cluster objects ( 73 ) and for disassembling which has cluster objects ( 73 ) into subobjects, the cluster decomposition device ( 74 ) feeding one of its subobjects to the search device ( 85 ) when a cluster object ( 73 ) is present. 17. The apparatus according to claim 16, characterized in that the cluster decomposition device ( 74 ) comprises a cluster recognition device ( 76 ) for recognizing a cluster object ( 73 ) and a device ( 82 ) which recognizes a sub-object in a cluster ( 73 ), the sub-object cleaved from the cluster ( 73 ) and fed to the search device ( 85 ). 18. The apparatus according to claim 17, characterized in that the cluster decomposition device ( 74 ) has a virtually optically operating difference generator ( 89 ) which subtracts from the cluster object ( 73 ) the reference object belonging to an identified sub-object and thus a modified cluster object ( 73 ) which is fed to the cluster recognition device ( 76 ). 19. Device according to one of claims 17 or 18, characterized in that the cluster recognition device ( 76 ) has a device ( 97 ) for determining a length ( 93 ) of the object ( 14 ) or cluster object ( 73 ) and a device ( 98 ) which is provided for determining widths ( 94 a, 94 b, 94 c) of the object ( 14 ) or cluster robjektes ( 73 ) running transversely to the length ( 93 ), and that a qualification device ( 99 ) is also provided , based on the deviations of the widths (94) to one another, and recognizes based on the position of the widths (94) to the length (93) whether the located object (14) is a cluster object (73). 20. Device according to one of claims 17 to 19, characterized in that the cluster detection device ( 76 ) has a device ( 100 ) which detects on the basis of movement processes in partial areas and / or related areas of the same color whether the localized object ( 14th ) is a cluster object ( 73 ). 21. Device according to one of claims 13 to 20, characterized in that the localization device ( 40 ) has an outline detector ( 56 ) which in the image data detects areas of the same true color areas detected as objects ( 14 ) and detects them and then closed Outlines ( 92 ) determined. 22. Device according to one of claims 13 to 21, characterized in that the image recording device ( 16 ) has an image recording system ( 17 ) with adjustable optical magnification device ( 18 ) and a displacement device ( 19 ) through which the sample ( 13 ) relative to the Magnification device ( 18 ) can be moved in such a way that image fields ( 51 ) distributed over its volume by the sample ( 13 ) can be recorded with different magnification settings by means of the image recording system ( 17 ). 23. Device according to claims 21 and 22, characterized in that the locator (40) an on device (57, 58) which are detected using the detector of the outline (56) in the frames (51) outlines (92 ) creates an overlay image ( 53 ) for an object ( 14 ) extending over several image fields ( 51 ). 24. The device according to claim 23, characterized in that the localization device ( 40 ) has a motion detector ( 59 ) which detects on the basis of the detected outlines ( 92 ) and / or the overlay image ( 53 ) whether the localized object ( 14 ) is form and / or is portable. 25. The device according to any one of claims 13 to 24, characterized in that the search device ( 85 ) has a comparison device ( 101 ) which, depending on output signals from evaluation units ( 102 , 103 , 104 , 105 ), for example for true color, movement , Size and geometric shape / form variability of the object ( 14 ) or sub-object to be identified searches a selected part of the reference objects specified in a reference object memory ( 87 ) in a virtual-optical manner for the object / sub-object. 26. Device according to one of claims 17 to 25, characterized in that the device ( 82 ) for recognizing and splitting off sub-objects breaks down a cluster object ( 73 ) into areas of different true colors and / or true color contrasts, and treats these areas as a sub-object. 27. The device according to one of claims 17 to 26, characterized in that the device ( 82 ) for recognizing and splitting off sub-objects breaks down a cluster object ( 73 ) into areas of different movement, shape and / or size, and treats these areas as a sub-object. 28. Device according to one of claims 13 to 27, characterized in that a reference object memory ( 87 ) is provided for the storage of the reference objects, in which the reference objects are stored in the form of virtual-optical three-dimensional vector surface graphic objects.