WO2011072698A1 - Stroboscopic counting of particles - Google Patents
Stroboscopic counting of particles Download PDFInfo
- Publication number
- WO2011072698A1 WO2011072698A1 PCT/DK2010/050345 DK2010050345W WO2011072698A1 WO 2011072698 A1 WO2011072698 A1 WO 2011072698A1 DK 2010050345 W DK2010050345 W DK 2010050345W WO 2011072698 A1 WO2011072698 A1 WO 2011072698A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sample
- image
- particles
- illumination
- image acquisition
- Prior art date
Links
- 239000002245 particle Substances 0.000 title claims abstract description 75
- 238000000034 method Methods 0.000 claims abstract description 80
- 230000003287 optical effect Effects 0.000 claims abstract description 45
- 239000007788 liquid Substances 0.000 claims abstract description 21
- 244000005700 microbiome Species 0.000 claims abstract description 21
- 238000005286 illumination Methods 0.000 claims description 61
- 238000012545 processing Methods 0.000 claims description 47
- 238000013519 translation Methods 0.000 claims description 44
- 230000014616 translation Effects 0.000 claims description 44
- 230000000638 stimulation Effects 0.000 claims description 23
- 238000001514 detection method Methods 0.000 claims description 21
- 230000005670 electromagnetic radiation Effects 0.000 claims description 12
- 230000003213 activating effect Effects 0.000 claims description 9
- 230000004936 stimulating effect Effects 0.000 claims description 8
- 230000005684 electric field Effects 0.000 claims description 4
- 238000005424 photoluminescence Methods 0.000 claims description 4
- 238000001914 filtration Methods 0.000 claims description 3
- 238000005070 sampling Methods 0.000 claims description 2
- 238000010186 staining Methods 0.000 claims description 2
- 230000005672 electromagnetic field Effects 0.000 claims 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 abstract description 24
- 241000894006 Bacteria Species 0.000 abstract description 6
- 238000012544 monitoring process Methods 0.000 abstract description 4
- 238000003384 imaging method Methods 0.000 description 15
- 238000005259 measurement Methods 0.000 description 13
- 230000004913 activation Effects 0.000 description 6
- 238000001994 activation Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000002360 preparation method Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 241000588724 Escherichia coli Species 0.000 description 2
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 230000001580 bacterial effect Effects 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000009849 deactivation Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 235000008733 Citrus aurantifolia Nutrition 0.000 description 1
- 240000004808 Saccharomyces cerevisiae Species 0.000 description 1
- 235000011941 Tilia x europaea Nutrition 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011496 digital image analysis Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 229910052742 iron Inorganic materials 0.000 description 1
- JEIPFZHSYJVQDO-UHFFFAOYSA-N iron(III) oxide Inorganic materials O=[Fe]O[Fe]=O JEIPFZHSYJVQDO-UHFFFAOYSA-N 0.000 description 1
- YOBAEOGBNPPUQV-UHFFFAOYSA-N iron;trihydrate Chemical compound O.O.O.[Fe].[Fe] YOBAEOGBNPPUQV-UHFFFAOYSA-N 0.000 description 1
- 239000004571 lime Substances 0.000 description 1
- 230000005923 long-lasting effect Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000004020 luminiscence type Methods 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 238000000386 microscopy Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000011514 reflex Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 239000003053 toxin Substances 0.000 description 1
- 231100000765 toxin Toxicity 0.000 description 1
- 108700012359 toxins Proteins 0.000 description 1
- 239000002351 wastewater Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06M—COUNTING MECHANISMS; COUNTING OF OBJECTS NOT OTHERWISE PROVIDED FOR
- G06M11/00—Counting of objects distributed at random, e.g. on a surface
- G06M11/02—Counting of objects distributed at random, e.g. on a surface using an electron beam scanning a surface line by line, e.g. of blood cells on a substrate
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1468—Optical investigation techniques, e.g. flow cytometry with spatial resolution of the texture or inner structure of the particle
- G01N15/147—Optical investigation techniques, e.g. flow cytometry with spatial resolution of the texture or inner structure of the particle the analysis being performed on a sample stream
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
- G01N2015/144—Imaging characterised by its optical setup
- G01N2015/1445—Three-dimensional imaging, imaging in different image planes, e.g. under different angles or at different depths, e.g. by a relative motion of sample and detector, for instance by tomography
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N2015/1486—Counting the particles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/06—Illumination; Optics
- G01N2201/064—Stray light conditioning
- G01N2201/0648—Shutters
Definitions
- the invention relates to a method for detecting particles in a liquid sample. Such a method can be applied for live monitoring of e.g. the amount of microorganisms, such as bacteria, in water samples from waterworks.
- the requirement for the quality of the water that comes from the waterworks is very high, demanding a frequent analysis of the water.
- the quality is usually checked at least once a month in smaller waterworks, and for larger waterworks much more frequent.
- the quality check is performed manually by acquiring a water sample from the works or from somewhere along the water pipes. The sample is transported to a laboratory for analysis. A range of parameters is determined, such as the level of iron, level of different toxins and the pH-value. These parameters will usually not change significantly from test to test.
- One important parameter that must be kept very low in the water is the number of microorganisms or total bacterial count. If the number of bacteria, such as E. coli bacteria increases the health of the user of the water is at risk. In case of pollution the number of bacteria may rise to health threatening levels very rapidly, and there is therefore a need for live monitoring of the total bacterial count. If pollution occurs, the water supply should be stopped immediately. Microscopy may be used for monitoring the quality of the water.
- the sample may e.g . be water at the waterworks that should be scanned for bacteria. Searching for small particles in a large volume requires a large number of high resolution images to be grabbed and processed. The high resolution is necessary to be able to determine if a detected particle is a microorganism or a particle comprised e.g. by ochre or lime scale.
- the acquisition of a large number of images involves read-out of data from a camera to a storage location which for large amounts of high quality images may take unacceptable long time. Furthermore the acquired images must be processed which involves reading the images from the storage location and applying complex algorithms which expands the time required per image acquired . If the microorganisms are al ive, they may move around in the sample, and therefore have changed position from one image to the next, making optical sectioning difficult or impossible.
- the image size may be reduced. This unfortunately reduces the size of the sample that may be scanned in a given time, and therefore reduces the probability of detecting the microorganisms at an early stage.
- a stroboscopic image is known which is produced by illuminating a scene multiple times in a single exposure with a stationary camera. It shows, as a single image (photograph), a manner of movement of the object. In the days of film cameras, such a stroboscopic image was taken by performing plural strobe light emissions on the moving object during a long-term exposure.
- the sample of water may be contained in a sample device.
- the microorganisms are substantially at stand still. Substantially at stand still may refer to the situation where there is no mass flow of the sample during the acquisition of the images.
- the optical sectioning may be impossible to carry out. It will thus not be possible to determine if a particle found is a harmful microorganism or if it is a harmless solid particle. Such stroboscopic imaging of moving objects may therefore not be used, as the objects are not moving.
- an optical detection assembly comprises an illumination device, such as a laser or a LED.
- the optical detection assembly further comprises an image acquisition device, such as a CMOS camera or a CCD camera.
- the optical detection assembly optionally comprises optics for providing an image of an object to be created on the image acquisition device.
- the optics may comprise lenses, apertures, prisms, and other optical devices used to create an image of an object.
- the optics may be assembled to comprise a dark field type or oblique type of microscope, but also other types of microscope assemblies may be used.
- the optical detection assembly further comprises a shutter, such as an iris-type shutter or a mirror type shutter as in a standard reflex camera and/or an electronic shutter.
- the optical detection assembly may further comprise a sample device base for holding a sample device comprising a liquid sample.
- the optical detection assembly may further comprise at least one translation unit for translating the sample device and the image acquisition device relative to each other.
- the optical detection assembly may also comprise a stimulating device for stimulating the sample in the sample device.
- the optical detection assembly may also comprise a processing device for processing the images acquired from the image acquisition device.
- the processing device may be adapted to store at least one image, such as being adapted to store a plurality of images.
- the processing device may be adapted to process the images acquired using one or more image processing algorithms.
- the processing device may be adapted to control the operation of the optical detection assembly.
- the controlling may comprise controlling the image acquisition device, i.e. activating and deactivating the shutter, read-out of images, storing of images, controlling the stimulating device, controlling the translation unit(s) and their mutual timing and activation.
- the optical detection assembly may be arranged in a housing supporting the optical detection unit, the sample device base, the illumination device, the stimulation device and the translation unit.
- the housing may further comprise the processing device as well as an output device for outputting data.
- the processing device may be an embedded processor running embedded software, or it may be a standard personal computer connected to the optical detection assembly.
- the output device may be a screen, a serial or parallel wired connection or it may be a wireless connection.
- At least a sub-volume of a liquid sample is prepared to be imaged / analysed. If the sample to be imaged / analysed is large, say many litres, and the concentration of the particles to be detected is very small, the number of scans to be made by the optical detection assembly may be very high. In this case it may be chosen to concentrate the particles in a smaller volume e.g. by filtering the sample. If the measurement to be made is a spot check of the sample, the measurement may be made without concentrating the sample.
- the preparation of the liquid sample may also comprise staining, tagging and/or filtering the particles in the sample, or if the sample comprises blood, the preparation may comprise haemolysing.
- the method comprises providing said sample to said sample device.
- the sample device may be a one-time use only disposable e.g. made of plastic or it may be a re-useable device e.g. made of glass or other long- lasting material.
- the sample comprised in the sample device may be replaced by a new sample.
- the amount of liquid sample in a sample device may be in the range of 0.1 micro litres to 100 micro litres.
- the sample device may be a part of a shunt to a main water pipe from the water work, said shunt going from the main water pipe though a valve to the sample device, and optionally further back to the main water pipe or through an outlet as wastewater.
- the valve is opened for a short period.
- the valve is closed again for the water to settle.
- the method comprises activating the shutter for acquisition of a long-time exposure image.
- the long-time exposure time may be as short as few milliseconds or even shorter, or, as long as hundreds of milliseconds or even many seconds.
- the shutter may be a physical shutter such as an Iris-type shutter or other aperture such as a mirror. When the shutter is activated, a physical barrier stopping light from exposing the image acquisition device is removed. When the shutter is deactivated, the physical barrier stops the light to fall upon the active area of the image acquisition device.
- the shutter may be an electronic shutter operated from the controlling device. The electronic shutter may be adapted to start and stop exposure of the image acquisition device.
- Stimulation may be provided to the sample from the stimulating device.
- the stimulation is in one embodiment applying an electric field across the sample.
- the electric field may be DC or AC.
- the stimulation may be accomplished by applying a magnetic field, applying acoustic waves or electromagnetic waves, such as ultra violet light (UV).
- the purpose of applying stimulation may be to create a change in the sample that may be used to characterise particles in the sample. If e.g. an electric field is applied, electrically loaded particles may be observed moving towards the poles of the field.
- the stimulation may be provided when the shutter is activated and the image acquisition device is open for exposure to electromagnetic radiation from the sample device and/or when the shutter is deactivated.
- the method comprises providing illumination from the illumination device to the liquid sample comprised in the sample device.
- the illumination comprise providing a short pulse of electromagnetic radiation (such as a flash of light) to the sample for illuminating at least a portion of the sample that is imaged onto the image acquisition device.
- the duration of the flash may range between a few microseconds to tenths or hundreds of milliseconds depending on the properties of the light source and the sample.
- the illumination may be provided as pulsed electromagnetic radiation. The intensity may be varied between successive flashes.
- the illumination may be generated using a LED or a laser, or it may be generated using a light bulb or other electromagnetic emitting means.
- the ill um ination is provided as a continuous wave illumination, i.e. the l ight is on as long as the shutter is activated.
- the illumination comprises providing wavelength multiplexing of at least two different electronic waves.
- the illumination may be comprised of electromagnetic waves with different polarisation. I n one embodiment, said illumination comprises photoluminescence or said illumination triggers the emission of photoluminescence.
- the electromagnetic radiation may be intensity multiplexed.
- said illumination comprises electromagnetic radiation, said electromagnetic radiation preferably being in the range of about 200 nm to about 1 100 nm, such as in the range of about 300 nm to about 800 nm, in the range of about 400 nm to about 700 nm, in the range of about 450 nm to about 600 nm, in the range of about 495nm to about 570nm.
- the method of the present invention comprises translating the sample device and the image acquisition device relative to each other.
- the translation is in one embodiment of the invention to move the just illuminated part of the sample device partly or completely out of the view of the image acquisition device and a new part of the sample device partly or completely into the view of the image acquisition device.
- a new illumination may be applied for further illuminating the sample and acquiring an image with the image acquisition device.
- the translation may be a rotation of the sample device or it may be a linear translation along one or more axes, or a tilt, or a combination of these.
- the translation may be relative to the image acquisition device.
- the sample device is moved a distance corresponding to at least the field of view of the image acquisition device between each activation of the illumination. This ensures that a particle is only illuminated once, making it easier to count the particles in the images, as every particle will show up on the image only once.
- the sample device is moved a distance shorter than the field of view of the image acquisition device between each activation of the illumination.
- the particles are illuminated more than one time for each image, and each particle will therefore be seen as similar objects in the image with equidistant spacing, and when used for optical sectioning the image may also yield a focus stack for each object.
- the sample device is translated a distance corresponding to approximately 1 -10 times the diameter of the particles in the sample device between each activation of the illumination device, such as 2-8 times the diameter, such as 3-5 times the diameter.
- This embodiment may be used for determining the trace of particles in the sample.
- the translation between the activations of the illumination could be selected to account for the movements of the particles between each illumination, in order to have the images of the particles separated in the combined image.
- the method may comprise a first procedure comprising said illumination, optionally said stimulation and optionally said translation.
- the first procedure may also be referred to as the measurement procedure.
- all parts, including the optional parts, of said first procedure are performed.
- the illumination, optionally the stimulation and optionally the translation of the first procedure may be carried out in different orders. E.g. the stimulation may be carried out before the illumination. If the stimulation of the sample generates a response from the sample that may comprise electromagnetic radiation, such as luminescence, it may not be necessary to carry out the illumination, as the illuminating is done in the stimulation process.
- the first procedure may be repeated at least one time.
- the illumination of the sample, and optionally the stimulation of the sample using the stimulation device, and optionally the translation of the sample device relative to the image acquisition device may be repeated at least one time, preferably more than one time, such as more than 5 times, such as more than 20 times or more than 100 times.
- the method may comprise deactivating the shutter for stopping the exposure of the active area of the image illumination device.
- the shutter is deactivated only during the illumination and stimulation and activated during the translation, i.e. the shutter is deactivated and activated a number of times before the image is read out.
- the method may comprise reading the image from the image acquisition device and to store the image in the processing device. After the reading and storing process the image is ready for processing in the processing device using image processing algorithms.
- the method of the present invention comprises processing the image to determine parameters characterising the particles in the liquid sample. The processing may comprise determining values of parameters relating to the concentration of particles, the relative concentration of different particles, the relative concentration of living and dead microorganisms, and/or to the movements of living microorganisms in said sample.
- the processing of the images may involve applying advanced algorithms to extract information regarding the particles.
- the extracted information may comprise the number of particles found in the image, the size and shape of the particles, the type of the particles, the movement pattern of the particles, the orientation of the particles, the particle focus stacks and the relative number of particles of each type of particles found.
- the processing may comprise an optical sectioning if said sample and/or one or more particles in said sample.
- the output device may be a display, an external device such as a USB device, as input to further procedures.
- the parameters to be output are to be used in a later part of the method and said output of said value of said parameters comprises applying said value to the later part of the method.
- the parameters may be stored internally in the processing device such as in dedicated registers of the processing device.
- the parameters may be used to determine if a predetermined condition has been reached .
- the method may comprise repeating a second procedure comprising one or more of said activating the shutter, said providing stimulation, said illumination, said translation, said deactivation of said shutter, said reading an image, said processing to determine parameters, and said outputting said determined parameters.
- Said second procedure may be repeated until a predetermined first condition has been reached.
- the first condition may be reached in the first repetition and the procedure is therefore only activated once.
- the second procedure may thus comprise said first procedure of illumination, stimulation and translation. In one embodiment, all parts including the optional parts of said second procedure are performed.
- the method may comprise a third procedure comprising providing a new sample into the sample device and re-initiating the second procedure from the beginning, i.e. said third procedure may comprise one or more of said preparing a liquid sample, said providing said sample to said sample device, said activating the shutter, said providing stimulation, said illumination, said translation, said deactivation of said shutter, said reading an image, said processing to determine parameters, said outputting, and said determining whether a first condition has been reached.
- the third procedure may thus comprise said first procedure and said second procedure. In one embodiment, all parts, including the optional parts, of said third procedure are performed.
- the starting over again with a new sample in the sample container may be repeated forever or at least a predetermined time or a predetermined number of times or to some predeterm ined cond ition has been reached .
- the predetermined stop condition could e.g. be the situation where an increased concentration of micro-organisms has been discovered.
- the measurement procedure may then be stopped and an alarm given.
- the alarm could e.g. be a sound signal given, a mail send to a predetermined receiver, or an electrical signal used to stop the pumps or close a valve at the waterworks.
- the method of the present invention may comprise repeating said third procedure, until a predetermined second condition has been reached.
- the second condition may be reached in the first repetition and the third procedure therefore only be activated once.
- the first condition and the second condition may be equal.
- the first condition and second condition determined from the determined parameters may be to stop imaging when detecting the end of the sample device.
- the first and/or second conditions may be to stop imaging when a desired volume of sample has been measured .
- the first and/or second conditions may be to stop imaging when detecting a particle in the sample, or a specific type a particle in the sample, or a specific number of particles in the sample.
- the first and/or second conditions may be to stop imaging when a predetermined number of translations has been made, or to stop when the translations has moved the sample a predetermined distance relative to the image acquisition device.
- the number of times the sample is illuminated and the sample container is moved may in one embodiment depend on the number of particles found in the previous repetition of the fi rst procedure. I f th e re i s a ve ry l ow concentration of particles in the sample, the number of illuminations may be increased to a high level. This will reduce the number of times to invoke the advanced algorithms and thereby lowering the requirements to the hardware.
- said processing comprises determining values of parameters relating to the relative concentration of different particles in said sample, such as the relative concentration of living and dead microorganisms in said sample.
- said processing comprises determining values of parameters relating to the movements of living microorganisms in said sample.
- the sample device is moved a distance corresponding to approximately N times the diameter of the particles in the sample device, before the activation of the illumination device.
- N may be 1 ,2,3,4,5,6,7,8,10 or in principle any integer or non-integer number.
- N may be 1 ,2,3,4,5,6,7,8,10 or in principle any integer or non-integer number.
- N is around 5 an image is exposed where a particle is imaged many times and may be used to extract information regarding the movement of the particle.
- Using a well-known translation of the sample device it is possible to predict where a particle should be positioned in an image during next exposure. If the particle is not located at the expected position, the particle has moved, and it is possible to determine parameters of the movement, such as direction and speed.
- the method for determining the value of at least one parameter characterising particles in a liquid sample comprises: a) providing an optical detection assembly comprising an illuminating device, an image acquisition device and a shutter,
- the method may comprise repeating f) to n) until a predetermined first condition has been achieved.
- the method may comprise repeating d) to o) until a predetermined second condition has been achieved.
- i) comprises deactivating said shutter before said translation and activating said shutter after said translation.
- the predetermined first condition and said second condition is selected from the group of detecting the end of said sample device, sampling a desired volume of sample, detecting a particle, detecting a desired number of particles or achieving a predetermined number of translations.
- Fig. 1 is a schematic view of an optical detection assembly (here an optical microscope) to be used when carrying out the method of the present invention
- Fig. 2 shows a schematic view of the timing involved in optical sectioning
- Fig. 3 shows a schematic view of the timing involved in stroboscopic optical sectioning
- Fig. 4 shows a schematic diagram of an embodiment of the invention
- Fig. 5 shows a schematic diagram of one embodiment of the invention
- Fig. 6 shows a schematic diagram of one embodiment of the invention
- Fig. 7 shows a theoretical example of a measurement
- Fig. 8 shows an image acquired using 20 illuminations of a sample
- Fig. 9 shows a trace identification graph of the image shown as Fig. 8
- Fig. 10 shows a slice of the image shown as Fig. 8, and
- Fig. 1 1 shows a trace identification graph of the image shown as Fig. 10.
- the figures are schematic and may be simplified for clarity.
- a sample device 18 comprising a sample 12 is shown. Referring to the coordinate system 22 the sample device 18 has a first confinement 26 and a second confinement 28 confining the sample 12 in the Z-direction. The sample device 18 may extend beyond an image acquisition area 10 in the X-direction as well as in the Y-direction. Especially in the X-direction the sample device 18 may extend beyond the initial image acquisition area 10. The sample 12 may be confined in all three dimensions to make sure the sample 12 is at a non- moving state or steady state when performing the measurements.
- An illuminating device 24 illuminates the sample 12 within the sample device 18.
- the first confinement 26 and the second confinement 28 are made of a material transparent for the electromagnetic waves from the illuminating device 24.
- An optical detection assembly 15 comprises an image acquisition device 16 and an objective lens 14.
- the objective lens 14 comprises a first optical axis 13 and an object plane 17 perpendicular to the first optical axis 13.
- the image acquisition area 10 of the sample 12 is arranged to be coinciding with the object plane 17 of the objective lens 14. This enables a 2-dimensional image or 2-dimensional measurement of the image acquisition area 10 of the sample 12 to be imaged onto the image acquisition device 16.
- the image acquisition area 10 may intersect the first confinement 26 as well as the second confinement 28.
- the sample device 18 may be moved relative to the optical detection assembly 15 using a translation unit 20 - in the figure symbolized by an arrow.
- the sample device 18 may be moved in the X direction in steps and for each step an image from the image acquisition device 16 is captured and stored in an image storing device for later use.
- the movement in the X d irection intersects the first optical axis 13.
- a translation unit for moving the sample device 18 in the Y-direction is used to enlarge the measurement volume.
- the size of the sample in the Y-direction may be sufficiently large to comprise the desired number of steps in that direction.
- the image acquisition area 10 may extend beyond the sample device 18, or at least extend beyond the first confinement 26 and the second confinement 28 of the sample device 18.
- the acquired images may comprise an image of the two confinements, and this information may be used to determine the height of the image acquisition area 10 and subsequently the distance between the two confinements.
- FIG. 2 a schematic view of the timing involved in standard optical sectioning is shown.
- the figure comprises 4 synchronised timelines each indicating when there is activity of one of the parts in an optical microscope (the optical detection assembly) used for optical sectioning.
- Line no. 1 indicates when the processing device is active applying advanced algorithms to images acquired.
- Line no. 2 indicates activity in the camera (i.e. the image acquisition device). It is indicated using literal ⁇ ' when the camera is open for Exposure, and indicated using literal 'RO' when the image is Read Out from the camera.
- line 3 it is indicated using literal "T” when the translation unit is moving the sample device relative to the camera, while in line 4 it is indicated using literal "L” when the illumination is turned on.
- the sequence is to turn the illumination on (i.e. said sample is illuminated) and to open the camera for exposure (i.e. to activate the shutter so that said image acquisition device is exposed to electromagnetic radiation from the sample device).
- the illumination is turned off, and the camera exposure is ended.
- the camera may be open for exposure before or after the illumination is turned on and accordingly the camera may be closed for exposure before or after the illumination is turned off. If the optical microscope has been designed to eliminate external illumination, it will only be the period where both the camera is open for exposure and the illumination is turned on, that the camera will see an illuminated object.
- the image is read out from the camera and it is stored in the storing device.
- the read out time is app. 200ms.
- the data is available to the processing device for applying advanced algorithms to determine parameters describing any particles found in the image.
- the processing time is typically larger than 500ms.
- the translation device may be invoked to move the sample to the next image acquisition position .
- the translation time is typically app. 1 ms.
- the sequence may be repeated starting at the opening of the camera for exposure.
- the overall sequence time for imaging one section of the sample device is at least 730ms and usually larger when more complex algorithms are applied.
- Fig. 3 a schematic view of the timing involved in utilising the method according to the present invention is shown. The figure comprises the same 4 synchronised timelines as shown in Fig. 2.
- the sequence is initiated by opening a camera (an image acquisition device) for exposure (Line 2) by activating said shutter.
- a sub-sequence is initiated.
- the sub-sequence comprises turning the illuminator on for app. 30ms and then off again and invoking the translation unit to translate the sample device and the camera relative to each other.
- the subsequence may be repeated a number of times, where after the camera is closed for exposure (i.e. the shutter is deactivated).
- the image is read out to a storage device, and the processing device may begin processing the image.
- the camera may be opened for exposure again and the sub-sequence of illuminating and translating may be continued.
- the processor may work simultaneously with the sub-sequence (said first procedure) of illuminating and translating.
- the best performance for getting parameters regarding the particles in the sample for as large a sample volume as possible is when the sub-sequence is stopped as soon as the calculations in the processing time has finished.
- the number of sub-sequences will therefore be 500ms divided by 31 ms which equals app. 16 illuminations per image. It should be emphasised that the indicated times for illumination, translation, read-out etc is for reference only - the times will vary depending on the hardware setup and the sample and illuminator used.
- Fig. 4 shows a schematic diagram of an embodiment of the invention.
- the method comprises preparation of a sample for measurement. After the preparation, the integration time of the camera (image acquisition device) is started, and the sequence of illuminating and translating the sample may be executed a number of times, such as X times. Finally the integration is stopped, and the processing of data including reading out from the camera may begin. It is thus seen that the camera is only exposed once but using X illuminations.
- Fig. 5 shows a schematic diagram of one embodiment of the invention. The method is similar to the one shown in Fig. 4, but the sequence of exposing the camera (incl. illuminating and translating) is repeated Y times to get Y images each comprising X illuminations. The images are acquired from the same sample device, and may be acquired from separate parts of the sample device or from the same part.
- Fig. 6 shows a schematic diagram of one embodiment. The method is similar to the one shown in Fig. 4, but the sequence of exposing the camera Y times is repeated Z times. For each of the Z times a new sample is prepared and the complete measurement method is repeated Y times each comprising X illuminations.
- Figure 7 shows an example of a measurement using the method of the present invention.
- the figure shows four different points in time ti (100), t 2 (101 ), t 3 (102) and t (104) of a measurement.
- an imaging system is depicted together with the intermediate image formed on the camera (the image acquisition device) of the imaging system.
- the sample device 106 containing the sample which in this example consists of two objects, a circle 1 10 and a triangle 1 1 1 , is imaged using an imaging system 104, and illuminated using a light source 109.
- the imaging system has a focus plane 107 intersecting the sample at an oblique angle.
- the two objects are depicted with their out of focus properties by to triangles with their main axis perpendicular to the focus plane of the imaging system 107.
- the light source is flashed, yielding an intermediate image to be formed on the camera of the imaging system 104.
- This intermediate image is showed in 108.
- the image depicts the two objects; the circle which will be in focus since the focus plane of the imaging system intersects the location of the circle in the sample, while the triangle will be out of focus since the focus plane does not intersect the triangle in the sample.
- a time t 2 the sample is moved along the direction 105 and the light source is flashed again.
- the resulting intermediate image is depicted in 1 12 - now the sample has moved so the circle is slightly out of focus, and the triangle is slightly more in focus than in 108. Notice that the objects from image 108 are still visible, since the imaging system is open for exposure during the whole period ti - t .
- images 1 13 and 1 14 it is shown how the circle becomes more and more out of focus and eventually disappears from the image field, while the triangle is becoming in focus and out of focus again.
- the image may be read from the camera of the imaging system and analyzed.
- Fig. 8 an image acquired using the method of the present invention is shown. The image is acquired using 18 illuminations of a sample comprising yeast.
- the translations between each illumination has been adjusted to fit to the size of the camera used as image acquisition device, i.e. a sample imaged in the lower part of the image in illumination no. 1 will be imaged in upper part of the image in illumination no. 18, and will be moved out of the image if an illumination (and translation) no. 19 had been used.
- the image has been cleaned up.
- the translation of the sample between each illumination corresponds to the vertical dimension (columns) in the image.
- the image clearly shows a number of bright areas (dots) concentrated in a number of columns in the image.
- Each column of dots corresponds to a series of illumination of a single particle.
- a vertical trace identification algorithm For calculating the number of particles a vertical trace identification algorithm has been applied and the result is shown in Fig. 9.
- the vertical trace identification algorithm simply creates a sum of all the pixel intensity values for each column in the image.
- the upper trace in Fig. 9 shows the result of the identification algorithm for an un-cleaned image, and the lower trace shows the result of the identification algorithm for the cleaned-up image shown in Fig. 9.
- the number of particles in the part of the sample covered by the measurement may be determined. In this case 24 spikes are easily identified.
- a slice of the image of Fig. 8 has been cut-out for further processing.
- the slice is made out of 40 columns of pixels centred on one of the particles identified in Fig. 9.
- a horizontal trace identification algorithm has been applied.
- the horizontal trace identification algorithm works similar to the vertical trace identification algorithm i.e. it creates the sum of pixel intensity values in the horizontal direction.
- the result of the horizontal trace identification algorithm is shown in Fig. 1 1 .
- the trace has a peak for each of the bright areas in the image, and the distance between the peaks are substantially equal .
- the distance between the peaks corresponds to the distance the translation of the sample relative to the camera.
- the column is further analysed for multiple particles by looking at the presence of multiple peaks within the travelled distance.
- the image of Fig . 10 may also be used for optical sectioning for determining details regarding the particle.
Landscapes
- Chemical & Material Sciences (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Dispersion Chemistry (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
Abstract
The invention relates to a method for detecting particles in a liquid sample. A stroboscopic principle is applied to image the particle and to provide an optical sectioning of the particles. The method has a large variety of applications such as live monitoring of e.g. the amount of microorganisms, such as bacteria, in water samples from waterworks.
Description
STROBOSCOPIC COUNTING OF PARTICLES
The invention relates to a method for detecting particles in a liquid sample. Such a method can be applied for live monitoring of e.g. the amount of microorganisms, such as bacteria, in water samples from waterworks.
The requirement for the quality of the water that comes from the waterworks is very high, demanding a frequent analysis of the water. The quality is usually checked at least once a month in smaller waterworks, and for larger waterworks much more frequent. The quality check is performed manually by acquiring a water sample from the works or from somewhere along the water pipes. The sample is transported to a laboratory for analysis. A range of parameters is determined, such as the level of iron, level of different toxins and the pH-value. These parameters will usually not change significantly from test to test. One important parameter that must be kept very low in the water is the number of microorganisms or total bacterial count. If the number of bacteria, such as E. coli bacteria increases the health of the user of the water is at risk. In case of pollution the number of bacteria may rise to health threatening levels very rapidly, and there is therefore a need for live monitoring of the total bacterial count. If pollution occurs, the water supply should be stopped immediately. Microscopy may be used for monitoring the quality of the water.
When searching for particles such as microorganisms in samples with low or very low concentration using techniques such as optical sectioning and digital image analysis, it is necessary to search in a relatively large volume of a sample. The sample may e.g . be water at the waterworks that should be scanned for bacteria. Searching for small particles in a large volume requires a large number of high resolution images to be grabbed and processed. The high resolution is necessary to be able to determine if a detected particle is a microorganism or a particle comprised e.g. by ochre or lime scale.
The acquisition of a large number of images involves read-out of data from a camera to a storage location which for large amounts of high quality images
may take unacceptable long time. Furthermore the acquired images must be processed which involves reading the images from the storage location and applying complex algorithms which expands the time required per image acquired . If the microorganisms are al ive, they may move around in the sample, and therefore have changed position from one image to the next, making optical sectioning difficult or impossible.
If the water has been polluted with a high level of microorganisms such as E. coli, it is desired to stop the supply immediately to avoid polluting the pipes and exposing the users of the water to the risk of becoming sick. It is therefore desired to have the measurement results ready immediately after acquisition of the images. Optical sectioning of large sample volumes for bacteria may therefore involve expensive electronics comprising fast processors and lots of RAM and disk space.
For decreasing the requirements to the processing electronics, the image size may be reduced. This unfortunately reduces the size of the sample that may be scanned in a given time, and therefore reduces the probability of detecting the microorganisms at an early stage.
A stroboscopic image is known which is produced by illuminating a scene multiple times in a single exposure with a stationary camera. It shows, as a single image (photograph), a manner of movement of the object. In the days of film cameras, such a stroboscopic image was taken by performing plural strobe light emissions on the moving object during a long-term exposure.
When searching for microorganisms in water the sample of water may be contained in a sample device. In order to be able to use optical sectioning, it is necessary that the microorganisms are substantially at stand still. Substantially at stand still may refer to the situation where there is no mass flow of the sample during the acquisition of the images.
If the microorganisms were moving, i.e. if the sample of water is moving within the sample device, the optical sectioning may be impossible to carry out. It will thus not be possible to determine if a particle found is a harmful
microorganism or if it is a harmless solid particle. Such stroboscopic imaging of moving objects may therefore not be used, as the objects are not moving.
There is therefore a need for a reduction of the amount of data to be transferred (read out) and processed without going on compromise on the amount of sample scanned for microorganisms. Further the images acquired must be of a quality where the optical sectioning may be utilised to determine the type of particles detected.
It is one object of the present invention to provide a method for reducing the number of images of an optical sectioning to be acquired at a given size of sample without compromising the certainty of detecting microorganisms in the sample.
In one embodiment of the present invention an optical detection assembly is provided. The optical detection assembly comprises an illumination device, such as a laser or a LED. The optical detection assembly further comprises an image acquisition device, such as a CMOS camera or a CCD camera. The optical detection assembly optionally comprises optics for providing an image of an object to be created on the image acquisition device. The optics may comprise lenses, apertures, prisms, and other optical devices used to create an image of an object. The optics may be assembled to comprise a dark field type or oblique type of microscope, but also other types of microscope assemblies may be used. The optical detection assembly further comprises a shutter, such as an iris-type shutter or a mirror type shutter as in a standard reflex camera and/or an electronic shutter. The optical detection assembly may further comprise a sample device base for holding a sample device comprising a liquid sample.
The optical detection assembly may further comprise at least one translation unit for translating the sample device and the image acquisition device relative to each other.
The optical detection assembly may also comprise a stimulating device for stimulating the sample in the sample device.
The optical detection assembly may also comprise a processing device for processing the images acquired from the image acquisition device. The processing device may be adapted to store at least one image, such as being adapted to store a plurality of images. The processing device may be adapted to process the images acquired using one or more image processing algorithms. The processing device may be adapted to control the operation of the optical detection assembly. The controlling may comprise controlling the image acquisition device, i.e. activating and deactivating the shutter, read-out of images, storing of images, controlling the stimulating device, controlling the translation unit(s) and their mutual timing and activation.
The optical detection assembly may be arranged in a housing supporting the optical detection unit, the sample device base, the illumination device, the stimulation device and the translation unit. The housing may further comprise the processing device as well as an output device for outputting data. The processing device may be an embedded processor running embedded software, or it may be a standard personal computer connected to the optical detection assembly. The output device may be a screen, a serial or parallel wired connection or it may be a wireless connection.
In one embodiment of the present invention at least a sub-volume of a liquid sample is prepared to be imaged / analysed. If the sample to be imaged / analysed is large, say many litres, and the concentration of the particles to be detected is very small, the number of scans to be made by the optical detection assembly may be very high. In this case it may be chosen to concentrate the particles in a smaller volume e.g. by filtering the sample. If the measurement to be made is a spot check of the sample, the measurement may be made without concentrating the sample.
The preparation of the liquid sample may also comprise staining, tagging and/or filtering the particles in the sample, or if the sample comprises blood, the preparation may comprise haemolysing. In one embodiment the method comprises providing said sample to said sample device.
The sample device may be a one-time use only disposable e.g. made of plastic or it may be a re-useable device e.g. made of glass or other long- lasting material. In one embodiment, the sample comprised in the sample device may be replaced by a new sample. The amount of liquid sample in a sample device may be in the range of 0.1 micro litres to 100 micro litres.
In one embodiment, the sample device may be a part of a shunt to a main water pipe from the water work, said shunt going from the main water pipe though a valve to the sample device, and optionally further back to the main water pipe or through an outlet as wastewater. When a fresh sample of water is to be applied to the sample device, the valve is opened for a short period. When the water in the sample device has been completely exchanged with new water, the valve is closed again for the water to settle.
In one embod iment, the method comprises activating the shutter for acquisition of a long-time exposure image. The long-time exposure time may be as short as few milliseconds or even shorter, or, as long as hundreds of milliseconds or even many seconds. The shutter may be a physical shutter such as an Iris-type shutter or other aperture such as a mirror. When the shutter is activated, a physical barrier stopping light from exposing the image acquisition device is removed. When the shutter is deactivated, the physical barrier stops the light to fall upon the active area of the image acquisition device. The shutter may be an electronic shutter operated from the controlling device. The electronic shutter may be adapted to start and stop exposure of the image acquisition device.
Stimulation may be provided to the sample from the stimulating device. The stimulation is in one embodiment applying an electric field across the sample. The electric field may be DC or AC. The stimulation may be accomplished by applying a magnetic field, applying acoustic waves or electromagnetic waves, such as ultra violet light (UV). The purpose of applying stimulation may be to create a change in the sample that may be used to characterise particles in the sample. If e.g. an electric field is applied, electrically loaded particles may be observed moving towards the poles of the field.
The stimulation may be provided when the shutter is activated and the image acquisition device is open for exposure to electromagnetic radiation from the sample device and/or when the shutter is deactivated.
In one embodiment, the method comprises providing illumination from the illumination device to the liquid sample comprised in the sample device. In one embodiment of the invention the illumination comprise providing a short pulse of electromagnetic radiation (such as a flash of light) to the sample for illuminating at least a portion of the sample that is imaged onto the image acquisition device. The duration of the flash may range between a few microseconds to tenths or hundreds of milliseconds depending on the properties of the light source and the sample. The illumination may be provided as pulsed electromagnetic radiation. The intensity may be varied between successive flashes. The illumination may be generated using a LED or a laser, or it may be generated using a light bulb or other electromagnetic emitting means. In one embod iment the ill um ination is provided as a continuous wave illumination, i.e. the l ight is on as long as the shutter is activated. In one embodiment the illumination comprises providing wavelength multiplexing of at least two different electronic waves. The illumination may be comprised of electromagnetic waves with different polarisation. I n one embodiment, said illumination comprises photoluminescence or said illumination triggers the emission of photoluminescence. The electromagnetic radiation may be intensity multiplexed.
In one embodiment, said illumination comprises electromagnetic radiation, said electromagnetic radiation preferably being in the range of about 200 nm to about 1 100 nm, such as in the range of about 300 nm to about 800 nm, in the range of about 400 nm to about 700 nm, in the range of about 450 nm to about 600 nm, in the range of about 495nm to about 570nm.
In one embodiment, the method of the present invention comprises translating the sample device and the image acquisition device relative to each other. The translation is in one embodiment of the invention to move the just illuminated part of the sample device partly or completely out of the view of the image acquisition device and a new part of the sample device partly or completely
into the view of the image acquisition device. After movement of the sample device, a new illumination may be applied for further illuminating the sample and acquiring an image with the image acquisition device.
The translation may be a rotation of the sample device or it may be a linear translation along one or more axes, or a tilt, or a combination of these. The translation may be relative to the image acquisition device.
In one embodiment, the sample device is moved a distance corresponding to at least the field of view of the image acquisition device between each activation of the illumination. This ensures that a particle is only illuminated once, making it easier to count the particles in the images, as every particle will show up on the image only once.
In one embodiment, the sample device is moved a distance shorter than the field of view of the image acquisition device between each activation of the illumination. In this embodiment the particles are illuminated more than one time for each image, and each particle will therefore be seen as similar objects in the image with equidistant spacing, and when used for optical sectioning the image may also yield a focus stack for each object.
In one embodiment of the invention, the sample device is translated a distance corresponding to approximately 1 -10 times the diameter of the particles in the sample device between each activation of the illumination device, such as 2-8 times the diameter, such as 3-5 times the diameter. This embodiment may be used for determining the trace of particles in the sample. For such an application, the translation between the activations of the illumination could be selected to account for the movements of the particles between each illumination, in order to have the images of the particles separated in the combined image.
The method may comprise a first procedure comprising said illumination, optionally said stimulation and optionally said translation. The first procedure may also be referred to as the measurement procedure. In one embodiment, all parts, including the optional parts, of said first procedure are performed.
The illumination, optionally the stimulation and optionally the translation of the first procedure may be carried out in different orders. E.g. the stimulation may be carried out before the illumination. If the stimulation of the sample generates a response from the sample that may comprise electromagnetic radiation, such as luminescence, it may not be necessary to carry out the illumination, as the illuminating is done in the stimulation process.
The first procedure may be repeated at least one time. The illumination of the sample, and optionally the stimulation of the sample using the stimulation device, and optionally the translation of the sample device relative to the image acquisition device may be repeated at least one time, preferably more than one time, such as more than 5 times, such as more than 20 times or more than 100 times.
When the illumination, stimulation and translation of the first procedure_have been repeated at least one time, the method may comprise deactivating the shutter for stopping the exposure of the active area of the image illumination device.
In one embodiment the shutter is deactivated only during the illumination and stimulation and activated during the translation, i.e. the shutter is deactivated and activated a number of times before the image is read out. When the exposure of the image illumination device has been stopped, the method may comprise reading the image from the image acquisition device and to store the image in the processing device. After the reading and storing process the image is ready for processing in the processing device using image processing algorithms. In one embodiment, the method of the present invention comprises processing the image to determine parameters characterising the particles in the liquid sample. The processing may comprise determining values of parameters relating to the concentration of particles, the relative concentration of different particles, the relative concentration of living and dead microorganisms, and/or to the movements of living microorganisms in said sample. The processing of the images may involve applying advanced algorithms to extract information
regarding the particles. The extracted information may comprise the number of particles found in the image, the size and shape of the particles, the type of the particles, the movement pattern of the particles, the orientation of the particles, the particle focus stacks and the relative number of particles of each type of particles found.
The processing may comprise an optical sectioning if said sample and/or one or more particles in said sample.
When processing the image one or more parameters may be determined and the determined parameters may be written to the output device. The output device may be a display, an external device such as a USB device, as input to further procedures. In one embodiment, the parameters to be output are to be used in a later part of the method and said output of said value of said parameters comprises applying said value to the later part of the method. The parameters may be stored internally in the processing device such as in dedicated registers of the processing device.
After processing the image and determining parameters characterising the particles in the image, the parameters may be used to determine if a predetermined condition has been reached . The method may comprise repeating a second procedure comprising one or more of said activating the shutter, said providing stimulation, said illumination, said translation, said deactivation of said shutter, said reading an image, said processing to determine parameters, and said outputting said determined parameters. Said second procedure may be repeated until a predetermined first condition has been reached. The first condition may be reached in the first repetition and the procedure is therefore only activated once. The second procedure may thus comprise said first procedure of illumination, stimulation and translation. In one embodiment, all parts including the optional parts of said second procedure are performed.
The method may comprise a third procedure comprising providing a new sample into the sample device and re-initiating the second procedure from the beginning, i.e. said third procedure may comprise one or more of said
preparing a liquid sample, said providing said sample to said sample device, said activating the shutter, said providing stimulation, said illumination, said translation, said deactivation of said shutter, said reading an image, said processing to determine parameters, said outputting, and said determining whether a first condition has been reached. The third procedure may thus comprise said first procedure and said second procedure. In one embodiment, all parts, including the optional parts, of said third procedure are performed. The starting over again with a new sample in the sample container may be repeated forever or at least a predetermined time or a predetermined number of times or to some predeterm ined cond ition has been reached . The predetermined stop condition could e.g. be the situation where an increased concentration of micro-organisms has been discovered. The measurement procedure may then be stopped and an alarm given. The alarm could e.g. be a sound signal given, a mail send to a predetermined receiver, or an electrical signal used to stop the pumps or close a valve at the waterworks.
The method of the present invention may comprise repeating said third procedure, until a predetermined second condition has been reached. The second condition may be reached in the first repetition and the third procedure therefore only be activated once. The first condition and the second condition may be equal.
The first condition and second condition determined from the determined parameters may be to stop imaging when detecting the end of the sample device. The first and/or second conditions may be to stop imaging when a desired volume of sample has been measured . The first and/or second conditions may be to stop imaging when detecting a particle in the sample, or a specific type a particle in the sample, or a specific number of particles in the sample. The first and/or second conditions may be to stop imaging when a predetermined number of translations has been made, or to stop when the translations has moved the sample a predetermined distance relative to the image acquisition device.
The number of times the sample is illuminated and the sample container is moved may in one embodiment depend on the number of particles found in
the previous repetition of the fi rst procedure. I f th e re i s a ve ry l ow concentration of particles in the sample, the number of illuminations may be increased to a high level. This will reduce the number of times to invoke the advanced algorithms and thereby lowering the requirements to the hardware. In one embodiment, said processing comprises determining values of parameters relating to the relative concentration of different particles in said sample, such as the relative concentration of living and dead microorganisms in said sample.
I n one embod iment, said processing comprises determining values of parameters relating to the movements of living microorganisms in said sample.
In one embodiment of the invention, the sample device is moved a distance corresponding to approximately N times the diameter of the particles in the sample device, before the activation of the illumination device. N may be 1 ,2,3,4,5,6,7,8,10 or in principle any integer or non-integer number. When N is around 5 an image is exposed where a particle is imaged many times and may be used to extract information regarding the movement of the particle. Using a well-known translation of the sample device, it is possible to predict where a particle should be positioned in an image during next exposure. If the particle is not located at the expected position, the particle has moved, and it is possible to determine parameters of the movement, such as direction and speed.
In one embodiment of the invention the method for determining the value of at least one parameter characterising particles in a liquid sample, comprises: a) providing an optical detection assembly comprising an illuminating device, an image acquisition device and a shutter,
b) optionally providing a stimulating device for providing stimulation to said sample,
c) providing a sample device for holding said liquid sample,
d) optionally preparing at least a sub-volume of said liquid sample, e) providing said liquid sample to said sample device
f) activating said shutter for exposing said image acquisition device to electromagnetic waves from said sample device,
g) optionally providing stimulation to said sample from said stimulating device
h) providing illumination from said illuminating device to said liquid sample comprised in said sample device
i) translating said sample device and said image acquisition device relative to each other, using a translation unit
j) repeating g), h) and i) at least one time
k) deactivating said shutter,
I) reading an image from said image acquisition device
m) processing sa id image to determ ine sa id value of at least one parameter characterising said particles in said liquid sample; and n) outputting said value of said parameter to an output device
The method may comprise repeating f) to n) until a predetermined first condition has been achieved.
The method may comprise repeating d) to o) until a predetermined second condition has been achieved. In one embod iment, i) comprises deactivating said shutter before said translation and activating said shutter after said translation.
In one embod iment, the predetermined first condition and said second condition is selected from the group of detecting the end of said sample device, sampling a desired volume of sample, detecting a particle, detecting a desired number of particles or achieving a predetermined number of translations.
Brief description of the drawings
Fig. 1 is a schematic view of an optical detection assembly (here an optical microscope) to be used when carrying out the method of the present invention,
Fig. 2 shows a schematic view of the timing involved in optical sectioning,
Fig. 3 shows a schematic view of the timing involved in stroboscopic optical sectioning,
Fig. 4 shows a schematic diagram of an embodiment of the invention, Fig. 5 shows a schematic diagram of one embodiment of the invention, Fig. 6 shows a schematic diagram of one embodiment of the invention, Fig. 7 shows a theoretical example of a measurement Fig. 8 shows an image acquired using 20 illuminations of a sample, Fig. 9 shows a trace identification graph of the image shown as Fig. 8, Fig. 10 shows a slice of the image shown as Fig. 8, and
Fig. 1 1 shows a trace identification graph of the image shown as Fig. 10. The figures are schematic and may be simplified for clarity.
Further scope of applicability of the present invention will become apparent from the detailed description g iven hereinafter. However, it should be understood that the detailed description and specific examples, wh ile indicating preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art from this detailed description.
The invention is defined by the features of the independent claim(s). Preferred embodiments are defined in the dependent claims. Any reference numerals in the claims are intended to be non-limiting for their scope.
Some preferred embodiments have been shown in the foregoing, but it should be stressed that the invention is not limited to these, but may be embodied in other ways within the subject-matter defined in the following claims.
Referring to Fig . 1 , an arrangement that may be applied in an optical microscope used as said optical detection assembly, will be described. A sample device 18 comprising a sample 12 is shown. Referring to the coordinate system 22 the sample device 18 has a first confinement 26 and a second confinement 28 confining the sample 12 in the Z-direction. The sample device 18 may extend beyond an image acquisition area 10 in the X-direction as well as in the Y-direction. Especially in the X-direction the sample device 18 may extend beyond the initial image acquisition area 10. The sample 12 may be confined in all three dimensions to make sure the sample 12 is at a non- moving state or steady state when performing the measurements.
An illuminating device 24 illuminates the sample 12 within the sample device 18. The first confinement 26 and the second confinement 28 are made of a material transparent for the electromagnetic waves from the illuminating device 24.
An optical detection assembly 15 comprises an image acquisition device 16 and an objective lens 14. The objective lens 14 comprises a first optical axis 13 and an object plane 17 perpendicular to the first optical axis 13. The image acquisition area 10 of the sample 12 is arranged to be coinciding with the object plane 17 of the objective lens 14. This enables a 2-dimensional image or 2-dimensional measurement of the image acquisition area 10 of the sample 12 to be imaged onto the image acquisition device 16.
In order to get the first confinement 26 and the second confinement 28 imaged onto the image acquisition device 16 and thereby comprised in the images, the image acquisition area 10 may intersect the first confinement 26 as well as the second confinement 28.
The sample device 18 may be moved relative to the optical detection assembly 15 using a translation unit 20 - in the figure symbolized by an arrow. The sample device 18 may be moved in the X direction in steps and for each step an image from the image acquisition device 16 is captured and stored in an image storing device for later use. The movement in the X d irection intersects the first optical axis 13.
In one embodiment of the invention a translation unit for moving the sample device 18 in the Y-direction is used to enlarge the measurement volume. The size of the sample in the Y-direction may be sufficiently large to comprise the desired number of steps in that direction. The image acquisition area 10 may extend beyond the sample device 18, or at least extend beyond the first confinement 26 and the second confinement 28 of the sample device 18. The acquired images may comprise an image of the two confinements, and this information may be used to determine the height of the image acquisition area 10 and subsequently the distance between the two confinements.
In fig. 2 a schematic view of the timing involved in standard optical sectioning is shown. The figure comprises 4 synchronised timelines each indicating when there is activity of one of the parts in an optical microscope (the optical detection assembly) used for optical sectioning. Line no. 1 indicates when the processing device is active applying advanced algorithms to images acquired. Line no. 2 indicates activity in the camera (i.e. the image acquisition device). It is indicated using literal Έ' when the camera is open for Exposure, and indicated using literal 'RO' when the image is Read Out from the camera. In line 3 it is indicated using literal "T" when the translation unit is moving the sample device relative to the camera, while in line 4 it is indicated using literal "L" when the illumination is turned on.
As may be seen, the sequence is to turn the illumination on (i.e. said sample is illuminated) and to open the camera for exposure (i.e. to activate the shutter so that said image acquisition device is exposed to electromagnetic radiation from the sample device). After app. 30ms the illumination is turned off, and the camera exposure is ended. The camera may be open for exposure before or after the illumination is turned on and accordingly the camera may be closed for exposure before or after the illumination is turned off. If the optical microscope has been designed to eliminate external illumination, it will only be the period where both the camera is open for exposure and the illumination is turned on, that the camera will see an illuminated object. Then the image is read out from the camera and it is stored in the storing device. The read out
time is app. 200ms. After the read out, the data is available to the processing device for applying advanced algorithms to determine parameters describing any particles found in the image. Depending on the number of particles and the complexity of the algorithms, the processing time is typically larger than 500ms. During the processing of the data, the translation device may be invoked to move the sample to the next image acquisition position . The translation time is typically app. 1 ms. After processing of the data, the sequence may be repeated starting at the opening of the camera for exposure. The overall sequence time for imaging one section of the sample device is at least 730ms and usually larger when more complex algorithms are applied.
The times indicated may of cause be varied, e.g. the illumination time may be varied depending on the type of illuminator used, the read-out time may be shorter or longer depending on the camera and other hardware in the setup, etc. but the overall picture of a long time for read out and calculation and a short time for exposure and translation will remain the same. In Fig. 3, a schematic view of the timing involved in utilising the method according to the present invention is shown. The figure comprises the same 4 synchronised timelines as shown in Fig. 2.
The sequence is initiated by opening a camera (an image acquisition device) for exposure (Line 2) by activating said shutter. During the exposure time, a sub-sequence is initiated. The sub-sequence comprises turning the illuminator on for app. 30ms and then off again and invoking the translation unit to translate the sample device and the camera relative to each other. The subsequence may be repeated a number of times, where after the camera is closed for exposure (i.e. the shutter is deactivated). After end of exposure, the image is read out to a storage device, and the processing device may begin processing the image. Immediately after end of reading out, the camera may be opened for exposure again and the sub-sequence of illuminating and translating may be continued. The processor may work simultaneously with the sub-sequence (said first procedure) of illuminating and translating.
The number of sub-sequences may be varied depending on the type of information required. When just counting particles in the sample, the number
of sub-sequences may be high, such as 50 or more, and when there is a need of more information regarding the single particle detected, the number of subsequences may be reduced to less than 1 0. If for an example 1 0 subsequences are needed, the processing time may be calculated to 10 times (illumination + translation) + one time read out which equals app. 310ms + 200ms = 51 0ms (using the same times as for Fig . 2.). In th is case the processing time is app. 70% of the processing time as described in Fig. 2. What is more important, the scanned volume is 10 times higher! This gives an overall processing time for one section of a sample to app. 51 ms or 14 times faster than for Fig. 2.
If the number of sub-sequences is increased to 50, the processing time for one sequence is calculated to 50 sub-sequences + one read out time = 1750ms which equals 35ms for each section in the sample similar to 21 times faster than for Fig. 2. The best performance for getting parameters regarding the particles in the sample for as large a sample volume as possible is when the sub-sequence is stopped as soon as the calculations in the processing time has finished. Using the times indicated previously, the number of sub-sequences will therefore be 500ms divided by 31 ms which equals app. 16 illuminations per image. It should be emphasised that the indicated times for illumination, translation, read-out etc is for reference only - the times will vary depending on the hardware setup and the sample and illuminator used.
Fig. 4 shows a schematic diagram of an embodiment of the invention. The method comprises preparation of a sample for measurement. After the preparation, the integration time of the camera (image acquisition device) is started, and the sequence of illuminating and translating the sample may be executed a number of times, such as X times. Finally the integration is stopped, and the processing of data including reading out from the camera may begin. It is thus seen that the camera is only exposed once but using X illuminations.
Fig. 5 shows a schematic diagram of one embodiment of the invention. The method is similar to the one shown in Fig. 4, but the sequence of exposing the camera (incl. illuminating and translating) is repeated Y times to get Y images each comprising X illuminations. The images are acquired from the same sample device, and may be acquired from separate parts of the sample device or from the same part.
Fig. 6 shows a schematic diagram of one embodiment. The method is similar to the one shown in Fig. 4, but the sequence of exposing the camera Y times is repeated Z times. For each of the Z times a new sample is prepared and the complete measurement method is repeated Y times each comprising X illuminations.
Figure 7 shows an example of a measurement using the method of the present invention. The figure shows four different points in time ti (100), t2 (101 ), t3 (102) and t (104) of a measurement. For each point in time the sample an imaging system is depicted together with the intermediate image formed on the camera (the image acquisition device) of the imaging system. The sample device 106 containing the sample, which in this example consists of two objects, a circle 1 10 and a triangle 1 1 1 , is imaged using an imaging system 104, and illuminated using a light source 109. The imaging system has a focus plane 107 intersecting the sample at an oblique angle. The two objects are depicted with their out of focus properties by to triangles with their main axis perpendicular to the focus plane of the imaging system 107. At time ti the light source is flashed, yielding an intermediate image to be formed on the camera of the imaging system 104. This intermediate image is showed in 108. The image depicts the two objects; the circle which will be in focus since the focus plane of the imaging system intersects the location of the circle in the sample, while the triangle will be out of focus since the focus plane does not intersect the triangle in the sample. A time t2 the sample is moved along the direction 105 and the light source is flashed again. The resulting intermediate image is depicted in 1 12 - now the sample has moved so the circle is slightly out of focus, and the triangle is slightly more in focus than in 108. Notice that the objects from image 108 are still visible, since the imaging system is open for exposure during the whole period ti - t . In the following images 1 13 and
1 14 it is shown how the circle becomes more and more out of focus and eventually disappears from the image field, while the triangle is becoming in focus and out of focus again. At time t (103), the image may be read from the camera of the imaging system and analyzed. In Fig. 8 an image acquired using the method of the present invention is shown. The image is acquired using 18 illuminations of a sample comprising yeast. The translations between each illumination has been adjusted to fit to the size of the camera used as image acquisition device, i.e. a sample imaged in the lower part of the image in illumination no. 1 will be imaged in upper part of the image in illumination no. 18, and will be moved out of the image if an illumination (and translation) no. 19 had been used.
To reduce the accumulated background intensity, the image has been cleaned up. The translation of the sample between each illumination corresponds to the vertical dimension (columns) in the image. The image clearly shows a number of bright areas (dots) concentrated in a number of columns in the image. Each column of dots corresponds to a series of illumination of a single particle. For calculating the number of particles a vertical trace identification algorithm has been applied and the result is shown in Fig. 9. The vertical trace identification algorithm simply creates a sum of all the pixel intensity values for each column in the image. The upper trace in Fig. 9 shows the result of the identification algorithm for an un-cleaned image, and the lower trace shows the result of the identification algorithm for the cleaned-up image shown in Fig. 9.
By counting the spikes of the lower trace the number of particles in the part of the sample covered by the measurement may be determined. In this case 24 spikes are easily identified.
In Fig. 10 a slice of the image of Fig. 8 has been cut-out for further processing. The slice is made out of 40 columns of pixels centred on one of the particles identified in Fig. 9. A horizontal trace identification algorithm has been applied. The horizontal trace identification algorithm works similar to the vertical trace identification algorithm i.e. it creates the sum of pixel intensity values in the
horizontal direction. The result of the horizontal trace identification algorithm is shown in Fig. 1 1 . The trace has a peak for each of the bright areas in the image, and the distance between the peaks are substantially equal . The distance between the peaks corresponds to the distance the translation of the sample relative to the camera. The column is further analysed for multiple particles by looking at the presence of multiple peaks within the travelled distance. The image of Fig . 10 may also be used for optical sectioning for determining details regarding the particle.
Claims
Claims
A m ethod for d eterm i n i ng th e va l u e of at l east on e pa ra m eter characterising particles in a liquid sample, comprising:
a) providing an optical detection assembly comprising an illuminating device, an image acquisition device and a shutter,
b) optionally providing a stimulating device for providing stimulation to said sample,
c) providing a sample device for holding said liquid sample,
d) optionally preparing at least a sub-volume of said liquid sample, e) providing said liquid sample to said sample device
f) activating said shutter for exposing said image acquisition device to electromagnetic waves from said sample device,
g) optionally providing stimulation to said sample from said stimulating device
h) providing illumination from said illuminating device to said liquid sample comprised in said sample device
i) translating said sample device and said image acquisition device relative to each other, using a translation unit
j) repeating g), h) and i) at least one time
k) deactivating said shutter,
I) reading an image from said image acquisition device
m) processing sa id image to determ ine sa id value of at least one parameter characterising said particles in said liquid sample
n) outputting said value of said parameter to an output device
The method according to claim 1 , further comprising
o) Repeating f) to n) until a predetermined first condition has been achieved. 3. The method according to claim 2, further comprising
p) Repeating d) to o) until a predetermined second condition has been achieved.
4. The method according to any of claims 1 to 3, wherein said preparing of said l iqu id sample is selected from the group of tagging, staining, haemolysing, and/or filtering said particles. 5. The method according to any of claims 1 to 4, wherein said illumination comprises electromagnetic radiation, said electromagnetic radiation preferably being in the range of about 200 nm to about 1 100 nm, such as in the range of about 300 nm to about 800 nm, in the range of about 400 nm to about 700 nm, in the range of about 450 nm to about 600 nm, in the range of about 495nm to about 570nm.
6. The method according to claim 5, wherein said electromagnetic radiation is pulsed. 7. The method according to claim 5, wherein said electromagnetic radiation is intensity multiplexed.
8. The method according to any of claims 1 to 7, wherein said illumination comprises wavelength multiplexing of at least two different electromagnetic waves.
9. The method according to any of claims 1 to 8, wherein said illumination comprises photoluminescence or said illumination triggers the emission of photoluminescence.
10. The method according to any of claims 1 to 9, wherein said stimulation is selected from the group of applying an electric field, a magnetic field, an electromagnetic field or an acoustic wave to said sample. 1 1 .The method according to any of claims 1 to 10, wherein said translation comprises rotating said sample device relative to said image acquisition device.
12. The method according to any of claims 1 to 1 1 , wherein said translation comprises a linear translation of said sample device relative to said image acquisition device. 13. The method according to any of claims 1 to 12, wherein said translation comprises tilting said sample device relative to said image acquisition device.
14. The method according to any of claims 1 to 13, wherein said processing comprises optical sectioning of said sample.
15. The method according to any of claims 1 to 14, wherein said processing comprises determining values of parameters relating to the concentration of particles in said sample.
16. The method according to any of claims 1 to 15, wherein said processing comprises determ ining values of parameters relating to the relative concentration of different particles in said sample. 17. The method according to any of claims 1 to 16, wherein said processing comprises determ ining values of parameters relating to the relative concentration of living and dead microorganisms in said sample.
18. The method according to any of claims 1 to 17, wherein said processing comprises determining values of parameters relating to the movements of living microorganisms in said sample.
19. The method according to any of claims 1 to 18, wherein said output of said value of said parameters comprises writing said parameters to a display.
20. The method according to any of claims 1 to 19, wherein said output of said value of said parameters comprises writing said parameters to an external device.
21.The method according to any of claims 1 to 20, wherein said output of said value of said parameters comprises applying said value to a later part of the method. 22. The method according to any of claims 1 to 21, wherein said predetermined first condition and said second condition is selected from the group of detecting the end of said sample device, sampling a desired volume of sample, detecting a particle, detecting a desired number of particles or achieving a predetermined number of translations.
23. The method according to any of claims 1 to 22, wherein i) comprise deactivating said shutter before said translation and activating said shutter after said translation.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DKPA200901354 | 2009-12-18 | ||
DKPA200901354 | 2009-12-18 | ||
US31659410P | 2010-03-23 | 2010-03-23 | |
US61/316,594 | 2010-03-23 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011072698A1 true WO2011072698A1 (en) | 2011-06-23 |
Family
ID=44166764
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/DK2010/050345 WO2011072698A1 (en) | 2009-12-18 | 2010-12-17 | Stroboscopic counting of particles |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2011072698A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2015066006A2 (en) | 2013-10-29 | 2015-05-07 | Idexx Laboratories, Inc. | Method and device for detecting bacteria and determining the concentration thereof in a liquid sample |
WO2021105439A1 (en) | 2019-11-29 | 2021-06-03 | Intubio Aps | A method and a system for analysing a fluid sample for a biological activity |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0551010A1 (en) * | 1991-12-30 | 1993-07-14 | Toa Medical Electronics Co., Ltd. | Apparatus for analyzing particle images |
US20060094109A1 (en) * | 2004-11-02 | 2006-05-04 | Immunivest Corporation | Device and method for analytical cell imaging |
US7295309B1 (en) * | 2003-12-09 | 2007-11-13 | United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Microparticle analysis system and method |
US20090079963A1 (en) * | 2005-11-04 | 2009-03-26 | Clondiag Gmbh | Device and method for the detection of particles |
-
2010
- 2010-12-17 WO PCT/DK2010/050345 patent/WO2011072698A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0551010A1 (en) * | 1991-12-30 | 1993-07-14 | Toa Medical Electronics Co., Ltd. | Apparatus for analyzing particle images |
US7295309B1 (en) * | 2003-12-09 | 2007-11-13 | United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Microparticle analysis system and method |
US20060094109A1 (en) * | 2004-11-02 | 2006-05-04 | Immunivest Corporation | Device and method for analytical cell imaging |
US20090079963A1 (en) * | 2005-11-04 | 2009-03-26 | Clondiag Gmbh | Device and method for the detection of particles |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2015066006A2 (en) | 2013-10-29 | 2015-05-07 | Idexx Laboratories, Inc. | Method and device for detecting bacteria and determining the concentration thereof in a liquid sample |
CN105899933A (en) * | 2013-10-29 | 2016-08-24 | 艾德克斯实验室公司 | Method and device for detecting bacteria and determining the concentration thereof in a liquid sample |
JP2017500884A (en) * | 2013-10-29 | 2017-01-12 | アイデックス ラボラトリーズ インコーポレイテッドIDEXX Laboratories, Inc. | Method and container for detecting bacteria in a liquid sample and determining their concentration |
EP3063527A4 (en) * | 2013-10-29 | 2017-10-18 | IDEXX Laboratories, Inc. | Method and device for detecting bacteria and determining the concentration thereof in a liquid sample |
US10359352B2 (en) | 2013-10-29 | 2019-07-23 | Idexx Laboratories, Inc. | Method and device for detecting bacteria and determining the concentration thereof in a liquid sample |
CN105899933B (en) * | 2013-10-29 | 2020-03-03 | 艾德克斯实验室公司 | Method for detecting bacteria and determining their concentration in a liquid sample |
US10914670B2 (en) | 2013-10-29 | 2021-02-09 | Idexx Laboratories, Inc. | Method and device for detecting bacteria and determining the concentration thereof in a liquid sample |
WO2021105439A1 (en) | 2019-11-29 | 2021-06-03 | Intubio Aps | A method and a system for analysing a fluid sample for a biological activity |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10884227B2 (en) | Rapid high-resolution imaging methods for large samples | |
US9360410B2 (en) | Method and particle analyzer for determining a broad particle size distribution | |
TWI647452B (en) | Testing equipment with magnifying function | |
CA2543521C (en) | Particle imaging system with a varying flow rate | |
US20150269403A1 (en) | Barcode reader having multiple sets of imaging optics | |
EP2413130A1 (en) | Observation device | |
JPH03255365A (en) | Method and device for measuring a plurality of optical characteristics of living specimen | |
CN110546545B (en) | Optical scanning device and method | |
EP3422288B1 (en) | Imaging a well of a microplate | |
JP2018532132A (en) | Digital pathology system | |
CN109313352A (en) | The analysis based on image of sample | |
JP2016161653A (en) | Photographing device and method | |
Agbana et al. | Detection of Schistosoma haematobium using lensless imaging and flow cytometry, a proof of principle study | |
WO2011072698A1 (en) | Stroboscopic counting of particles | |
WO2013126019A1 (en) | A digital imaging system for biopsy inspection | |
US20080170772A1 (en) | Apparatus for determining positions of objects contained in a sample | |
JP2011197283A (en) | Focusing device, focusing method, focusing program, and microscope | |
CN110998330B (en) | Methods and systems for analyzing fluorescent immunoblotches | |
CN108627511A (en) | A kind of microoptic imaging detection method and device | |
US9134240B2 (en) | System and method for evaluating material in rotary motion | |
JP2006081427A (en) | Method for detecting bacterium and device for detecting bacterium | |
EP3901683A1 (en) | Method of controlling imaging of a sample by a microscope and corresponding microscope | |
US11408815B2 (en) | Method and a device for quantifying living organisms and use of a device | |
US20160341654A1 (en) | Dark field flow cytometry imaging system | |
JP2007033327A (en) | Flaw detecting method and flaw detector |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10837067 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 10837067 Country of ref document: EP Kind code of ref document: A1 |