EP4602347A1 - Device for analyzing samples of microorganisms in liquids - Google Patents
Device for analyzing samples of microorganisms in liquidsInfo
- Publication number
- EP4602347A1 EP4602347A1 EP22823615.4A EP22823615A EP4602347A1 EP 4602347 A1 EP4602347 A1 EP 4602347A1 EP 22823615 A EP22823615 A EP 22823615A EP 4602347 A1 EP4602347 A1 EP 4602347A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- liquid
- images
- dilutant
- flux
- microorganisms
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1468—Optical investigation techniques, e.g. flow cytometry with spatial resolution of the texture or inner structure of the particle
- G01N15/147—Optical investigation techniques, e.g. flow cytometry with spatial resolution of the texture or inner structure of the particle the analysis being performed on a sample stream
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1404—Handling flow, e.g. hydrodynamic focusing
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1429—Signal processing
- G01N15/1433—Signal processing using image recognition
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1404—Handling flow, e.g. hydrodynamic focusing
- G01N15/1409—Handling samples, e.g. injecting samples
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N2015/1006—Investigating individual particles for cytology
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N2015/1486—Counting the particles
Definitions
- Microorganisms in liquids e.g., bacteria, fungi, microalgae, archaea or protists
- qPCR quantitative Polymerase Chain Reaction
- the method comprises providing the device.
- the method also comprises connecting the liquid input channel to an external liquid medium containing microorganisms.
- the method also comprises taking liquid from the external liquid medium into the liquid input channel.
- the method also comprises, at the microfluidic slide, receiving the liquid from the input liquid channel or a mixture of the liquid from the liquid input channel and of dilutant from the dilutant input channel.
- the method also comprises capturing a flux of images of the microfluidic slide with the microscope.
- the method also comprises receiving and processing the flux of images with the electronic system.
- FIG. 6 shows examples of applications of the device; and 6 shows examples of results obtained by applications of the device;
- FIG. 7 shows an example of a remote system that may communicate with the device.
- FIG. 8 shows an example of the GUI.
- the device comprises a fluidics system.
- the fluidics system comprises a liquid input channel configured to take in a liquid containing microorganisms from an external liquid medium.
- the fluidics system comprises a liquid input channel configured to take in, from an external liquid medium, a liquid containing microorganisms.
- the fluidics system also comprises a dilutant input channel configured to take in dilutant from a dilutant source.
- the fluidics system also comprises a dilutant input channel configured to take in, from a dilutant source, dilutant.
- the fluidics system also comprises a microfluidic slide.
- the microfluidic slide is configured for receiving a mixture of the liquid from the liquid input channel and of the dilutant from the dilutant input channel.
- the microfluidic slide is configured for receiving a mixture of the liquid (taken in the liquid input channel) from the liquid input channel and of the dilutant (taken in dilutant input channel) from the dilutant input channel.
- the device also comprises an optics system.
- the optics system comprises a microscope.
- the microscope is arranged for capturing a flux of images of the microfluidic slide.
- the device also comprises an electronic system.
- the electronic system comprises a processing unit.
- the processing unit is configured for receiving and processing of the flux of images from the microscope.
- the microfluidic slide is configured to receive the mixture of the liquid from the liquid input channel and of the dilutant from the dilutant input channel, this allows an efficient flow of the microorganisms contained in the liquid.
- the electronic system captures continuously (e.g., "on the fly") a flux of images which corresponds to a stream of microorganisms as these traverse the fluidics system. This further allows an improved discrimination and analysis of the microorganisms contained in the liquids.
- the dilution indeed avoids saturation of the analyzed sample of liquids by a too high number of microorganisms, thus facilitating subsequent image analysis by the electronic system.
- the device allows a processing on-the-fly of the images of the liquids, thereby reducing waiting times and improving reliability against the formation of sediments or clogs in the fluidics system. It is accordingly further proposed a method for analyzing samples of microorganisms in liquid media.
- the method comprises providing the device.
- the method also comprises connecting the liquid input channel to an external liquid medium containing microorganisms.
- the method also comprises taking liquid from the external liquid medium into the liquid input channel.
- the method also comprises, at the microfluidic slide, receiving the liquid from the input liquid channel or a mixture of the liquid from the liquid input channel and of dilutant from the dilutant input channel.
- the method also comprises capturing a flux of images of the microfluidic slide with the microscope.
- the method also comprises receiving and processing the flux of images with the electronic system.
- the fluidics system may be an independent system and may be contained in a waterproof enclosure.
- the optics system and the electronic system may be protected from leaks of liquid.
- the optics system and/or the electronic system may also be contained in a waterproof enclosure to prevent accidental spills of liquid.
- the liquid input channel may have any geometry (e.g., straight, or allowing a degree of curvature) adapted for allowing the flow of the liquid in a small scale (e.g., sub-millimeter scale).
- the liquid input channel may be made of a flexible or rigid material.
- the fluidics system also comprises the microfluidic slide.
- microfluidic it is meant any property for allowing the control and manipulation of fluids in a small scale, e.g., below 1mm or less, even at micro-meter scale or less.
- the microfluidic slide may be a microscopically thin flat conduit made (at least in part) of transparent material, e.g., a conduit enclosed by a pair of parallel sheets of transparent material such as glass separated by a gap (also called “channel”). A conduit enclosed by a pair of parallel sheets of transparent material such as glass separated by a gap (also called “channel”). The gap between the pair of parallel sheets may allow the flow of liquid in its interior.
- the microfluidic slide is configured for receiving a mixture of the liquid from the liquid input channel and of the dilutant from the dilutant input channel.
- the microfluidic slide may have at least one entry connector (e.g., a Luer connector) be fed from the liquid input channel and the dilutant input channel, e.g., two independent connectors that are connected to the microfluidic slide (and thus the liquid and the dilutant mix within the microfluidic slide) or (alternatively) a single connector (and thus the liquid and the dilutant mix are already mixed when entering the microfluidic slide) configured to maintain the mixture of the liquid and/or throw out said liquid.
- the microfluidic slide may have at another output connector configured for throwing out the mixture.
- the dilutant may be conveyed to the dilutant input channel through a dilutant input conduit (e.g., flexible tube) connected to an external dilutant medium (such as a reservoir of water).
- the dilutant input conduit may be part of or external to the device.
- the device may include a dilutant input port which may be configured for connecting or disconnecting the dilutant input conduit to/from the device.
- the dilutant port may be arranged on the enclosure of the device.
- the dilutant input port may be connected at one end to the dilutant conduit, and at the other end to the dilutant input channel.
- the dilutant source may be a reservoir placed inside the device (e.g., a portable reservoir).
- the dilutant port may thus be arranged inside the device, e.g., as part of the fluidics system.
- the electronic system may comprise a set of circuits, a processing unit and/or memory.
- the memory may comprise a computer program comprising instructions that, when executed by the device, cause the device to receive, process data, and sending and/or receiving instructions to (or from) the optics system and/or the fluidics system and to other external systems.
- the memory may also comprise the computer program comprising instructions configured for causing the processing unit to display the graphical user interface (GUI) on a screen.
- GUI graphical user interface
- the screen may be mounted on the device and/or may be remotely located on the remote system. The device may thus communicate remotely to the client computer system, so as to allow remote user-interaction with the device.
- the electronic system may further comprise a transmission system configured for transmitting the obtained flux of images, e.g., through a network to the remote system.
- the transmission system may be any set of circuitry configured for processing the obtained flux of images as data packets for its transmittal and/or storage.
- the transmission system may comprise a wireless transmitter (such as a Wi-Fi transmitter or Bluetooth transmitter) and/or wired transmitter (such as an Ethernet transmitter).
- the transmission system may be configured to transmit the flux of images to the remote system.
- the transmission system may be configured for receiving instructions for controlling the fluidics system, the optics system and/or the electronics system.
- the device may be configured to transmit the flux of images to the remote system, e.g., through the network.
- the device may comprise a peristaltic pump connected to the dilutant input channel.
- the peristaltic pump may be configured for changing the speed at which the liquid is carried through the input liquid channel.
- the device may send instructions to vary the speed of the carrying by the peristaltic pump.
- the processing unit may be configured for performing an estimation of a mass of microorganisms in the flux of images.
- estimate of a mass it is meant that the result of the application (by the processing unit) of any series of image processing operations to the flux of images to obtain a number relative to an area of the flux of images covered by the microorganisms, e.g. the quantity of microorganisms or the area occupied by an agglomeration of the microorganisms on the at least part of the microfluidic slide captured by the flux of images.
- the processing unit may be configured to perform the variation of the proportion of dilutant in the mixture based on the estimated mass.
- the processing unit may send instructions for allowing or stopping or varying the amount of the reception of the dilutant as a function of the estimated mass.
- the variation may be performed in any predetermined manner.
- the reception of dilutant may be stopped if there is the estimated mass is below a threshold.
- the amount of received dilutant may be varied according to an increasing function of the estimated mass.
- the processing unit may be configured for enabling flow of the dilutant input channel when the estimated mass of microorganisms is above a predetermined threshold, and for disabling flow of the dilutant input channel otherwise.
- the method may allow the complete input of dilutant to the microfluidic slide when the estimated mass of microorganisms is above the predetermined threshold and stopping the input when the estimated mass of microorganisms is below the predetermined threshold.
- the adaptive thresholding may create at least one segment on the flux of images.
- segment it is meant any closed shape, such as a square or circle.
- the area of the at least one segment may comprise at least one or more microorganism.
- the estimated mass may correspond (approximately or exactly) to the area of the at least one segment, or the sum of the area of the segments when there is more than one segment.
- performing the estimation of the mass of microorganisms in the flux of images may comprise applying a neural network classifier on the flux of images.
- the neural network classifier may be configured to determine the mass of microorganisms on the flux of images.
- the neural network classifier may be a machine learnt model comprising classification rules for detecting the mass of microorganisms in the image.
- the neural network may be configured to determine at least one localization or position (e.g., in x,y-coordinates) comprising a respective estimated mass of the microorganism.
- the estimated mass may correspond (approximately or exactly) to the estimation of the mass at the at least one localization, or the sum of masses when there is more than one localization.
- the mixture may be varied by the mixer, and thus the density of microorganisms may be varied in any manner so as to allow an improved observation of the microorganisms (e.g., by allowing a relatively large proportion of dilutant to enter so as to allow a better discrimination of the microorganisms).
- the processing of the flux of images is more accurate. This is because the density of the objects is also decreased, thereby improving the individual discrimination of all of the elements on the flux of images.
- the processing unit may input the dilutant when determining that a mass of molds in the microfluidic slide is too large (with respect to the predetermined threshold). Thus, the processing unit ensures the molds can be evacuated and continue the image processing afterwards.
- the device benefits of an improvement of the analysis of the samples of microorganisms, all while increasing the reliability of the device in terms of avoiding clogs in the microfluidic slide.
- processing unit when processing unit performs the variation of the proportion of dilutant in the mixture based on the estimated mass, the processing units sorts out excess of microorganisms when the estimated mass of microorganisms is above the predetermined threshold.
- the processing may allow, e.g., a maximum of 50 to 70 objects in the image prior to adding dilutant to the mixture (e.g., pure water). This allows an improved analysis of the images, as the electronic system may focus on the individual features of the microorganisms of the images, thanks to the reduced number of objects present in the image. In addition, this avoids sediments of microorganisms, e.g., microorganisms colliding with each other or with other objects, or sediments of molds in liquid coming from large oil tanks.
- the integration of the systems in the device results in a high reliability. This is especially the case when at least one of the fluidics system, the optics system and/or the electronic system is an independent system. Indeed, in this case, the independent system may be independently modulated without the need of interfering with the whole device, e.g., the independent system may be simply replaced. Thus, the device is guaranteed to have reduced downtimes (that is, a time period when the device is not operational).
- the optics system may also comprise at least one (e.g., all) of a light source, a light source intensity modulator, an Abbe type condenser, an objective, at least one convergent lens, a diaphragm and an integrated electronic camera.
- the light source may comprise at least one (e.g., several) LED(s).
- the intensity modulator is configured to modulate the intensity of the at least one LED.
- the intensity modulator may be configured to received instructions from the electronic system for modulating the intensity of the light source.
- the Abbe type condenser may be positioned close to the microfluidic slide and with the at least one convergent lens and the diaphragm.
- the optic system allows to realize an efficient illumination of the microorganisms in the microfluidic slide (e.g., Kohler illumination methods) when capturing the flux of images of the microfluidic slide.
- the processing unit may be configured for providing pulsations to the liquid input channel of a first predetermined duration.
- pulses it is meant any instruction sent to the fluidics system (e.g., digital pulses such as a train of pulses or analogic electrical stimulus, e.g., an AC pulse) configured for activating or regulating the input of liquid supplied to the microfluidic slide.
- the fluidics system upon reception of the pulsations, the fluidics system.
- the processing unit may communicate to the fluidics system so as to open the valve and/or supply the liquid with the motor to each input of the mixer based on the pulsations.
- the processing unit may send a complete pulsation to the valve for opening completely the valve (e.g., such as an "ON/OFF" control of the valve).
- the processing unit may send a train of pulses (e.g., a PWM pulse) to the (electrical) motor so as to regulate the flow of liquid into the mixer.
- the first predetermined duration may be set in any predetermined manner.
- the first predetermined duration may be comprised between 50ms and 50s or even 10ms and 10ms.
- the provided pulsations may be configured so that the liquid input channel takes in liquid from the external liquid medium during the first predetermined duration.
- the liquid input channel only takes in liquid when the pulsation is applied.
- the capturing of the flux of images from the microscope may comprise stopping the providing of pulsations during a second predetermined duration.
- the capturing of the flux of images by the microscope may be performed only when there is no flowing of liquid through the input microfluidic channel.
- the processing unit may send instructions to the microscope for starting the capturing of the flux of images of the microfluidic slide when the pulsation of the first predetermined duration is over.
- the second predetermined duration may be set in any predetermined manner so as to allow image capture.
- the second predetermined duration may be comprised between 50ms and 3s or even between 33ms and 60ms.
- the second predetermined duration may be of even 16.66ms or less.
- the processing unit may provide another pulsation of the first predetermined duration, after the microscope has captured the flux of images during the second predetermined duration, so as to re-start the flow of liquid to the liquid input channel.
- the microscope may take another flux of images during another second predetermined duration.
- the device may further comprise one or more supporting structures.
- support structure it is meant any part or assembly of parts (e.g., mechanical parts) that bears a load or force (e.g., gravitational load) of the device.
- the one or more supporting structures is arranged so as to define a supporting direction for the device.
- the supporting direction is thus an oriented line where the bearing of the load or force is concentrated.
- the loads exerted on the device follow the supporting direction when the device is installed so as to be supported by the one or more supporting structures.
- the microfluidic slide may be arranged in a direction parallel to the supporting direction of the device. In other words, the microfluidic slide is arranged so that the mixture of the liquid flows co-linearly to the supporting direction.
- the electronic system may be further configured to determine a universal time and a localization of each captured image.
- the electronic system may comprise circuitry configured to determine the location of the device and the universal time.
- the electronic system may optionally comprise a global position system (GPS) chip being configured for obtaining the universal time and the localization of the device.
- GPS global position system
- the processing of the flux of images from the microscope may comprise adding obtained universal time and the localization of the device to the flux of images.
- the method may add, to each image of the flux, a corresponding localization and a respective universal time.
- the flux of images thus comprises information on the localization in which the flux of images was taken, and the time in which each image was taken.
- the transmission system may be configured for transmitting the obtained flux of images with the added information. Alternatively, the transmission system may incorporate the corresponding localization and the respective universal time to each image when transmitting the flux of images, e.g., to a remote system.
- the GUI may comprise interface screens allowing to selectively activate the transmission of the flux of images.
- the GUI may allow the processing unit to process each image so as to be converted to the EXIF format.
- the processing unit may add the universal time and the localization of the device to each image in the EXIF format.
- the transmission system may incorporate the universal time and the localization of the device to the flux of images.
- the external liquid medium may be, for example an aqueous liquid contained in a pond of a bioreactor (e.g., an open pond system or a closed pond system) or oil from a large oil tank.
- the external liquid medium may be a bio-solvent, liquid proceeding from a biological fermentation process, wastewater, water containing phytoplankton, e.g., from an aqueous matrix such as sea water, fresh water or liquid digestate.
- the external liquid medium may thus come from various industrial fields.
- the device may be reusable, and thus the method may provide the device more than once, e.g., by different persons, in different places or industrial premises, or a single place comprising different external liquid media.
- the device may be provided in a first method, and thus the liquid input channel may be connected to a first external liquid medium.
- the device may be disconnected to the second external liquid medium and then in, a second method, the device may be connected to a second external liquid medium (different from the first medium).
- the second medium is different from first medium, e.g. different container, within a same industrial premise or in another premise.
- a user may connect the device to a first microalgae culture and perform the method.
- the user may disconnect the device and transfer it to a second microalgae culture to perform the method.
- the device may be reconnected on the same first external liquid medium, although at a different place and at a different time.
- a plurality of devices may also be connected to a same external liquid medium, thereby allowing massive analysis of images of the liquid medium.
- a plurality of devices may be connected to different external liquid media. For instance, a first and second device connected to an external liquid medium, a third device to another external liquid medium and so on, thereby allowing massive analysis of images of the liquid medium.
- the receiving and processing of the flux of images may comprise detecting microorganisms present in the flux of images.
- detecting it is meant that the device is configured to apply image processing techniques for determining the presence of the microorganism with respect to the background of the image.
- the processing unit detects microorganisms present in the image
- the receiving and processing of the flux of images may comprise estimating a value of one or more biological attributes of microorganisms present in the flux of images. The method may thus first perform the detection of microorganisms prior to estimating the value of one or more biological attributes, if the microorganism is not detected, or only perform the estimation of the value of one or more biological attributes.
- biological attribute any variable having values each forming a piece of information indicative of a biological characteristic of at least one microorganism present in the flux of images.
- Each value (e.g., numeric or alphanumeric value or vector) of the biological attribute may be related to a biological characteristic of an individual microorganism, or a biological characteristic of the microorganism in interaction with the liquid and/or with other microorganisms present in the flux of images.
- the device extracts more accurate information from the microorganisms present in the flux of images.
- the analyzed flux of images may be enriched with information such as the species of the microorganism, the dimension (such as height) of the microorganism, the number of microorganisms present in the image and/or distribution (or density) of the microorganisms in the image.
- the electronic system may comprise a memory having recorded thereon one or more neural networks configured for performing the detection and/or estimation.
- the one or more neural networks are configured to receive images of the flux of images (e.g., sequentially) and to output, on each respective image, a respective localization of a detected microorganism and/or values of the one or more biological attributes with input microscopic images.
- the processing unit may provide the flux of images to the one or more neural networks as input images, e.g., sequentially in the order as the images are found in the flux of images and to obtain the output by the one or more neural networks as the estimation of the value of one of the biological attributes.
- the one or more neural networks may output a different value on a given localization when the one or more neural networks determine that the value computed at the given localization does not correspond to one or more of (e.g., all of) the biological attributes.
- the one or more neural networks may apply a confidence threshold for determining whether the output satisfies the one or more of the biological attributes. For example, when a respective localization contains an object such as a contaminant, the one or more neural networks may determine that the value computed at the respective localization does not satisfy the confidence threshold for the one or more biological attributes.
- the one or more neural networks may output a value "other" at the respective localization.
- the one or more neural networks may have an evolutionary training, that is, a localization not satisfying the one or more of the biological attributes may be used for re-training the one or more neural networks.
- the one or more neural networks may thus be configured to output new one or more biological attributes (if the object is a biological object).
- the processing unit may add the estimated value as a data packet for its transmittal by the transmission system.
- the device leverages from the accuracy achieved by the one or more neural networks to analyze the samples of microorganisms.
- the use of (trained) neural networks results in relatively fast processing times, all while yielding an accurate estimation of the one or more biological attributes of the microorganisms present in the flux of images.
- Each neural network (of the one or more neural networks) may have been trained according to a machine-learning method (i.e., the value of its weights and parameters ensure a level of prediction/inference which reflects such training).
- the machine-learning method may comprise providing a dataset comprising a set of training patterns.
- the dataset impacts the speed of the learning of the one or more neural networks and the quality of the learning, that is, the accuracy of the trained one or more neural networks to analyze the flux of images.
- the dataset may be provided with a set of training patterns that depends on the contemplated quality of the learning for performing the detection and/or estimation of the microorganisms in liquids. This set may comprise a number of training samples higher than 1 000, 10 000, or yet 100 000 training samples comprising the contemplated variety of microorganisms and/or its biological attributes.
- the machine-learning method may also leverage from other training patterns of the dataset not included in the set, e.g., training patterns not containing any microorganism, e.g., such as a training pattern comprising images of liquid medium or training patterns comprising images of microorganisms together with other objects such as polluants.
- the quantity of the data in the dataset contemplated for the training thus follows a tradeoff between the accuracy to be achieved by the one or more neural networks, and the speed of the training.
- Each training pattern may comprise a microscope image of a sample of a liquid medium containing microorganisms (e.g., mold in oils or phytoplankton in seawater) and one or more annotations and/or other objects (such as contaminants).
- At least one annotation may comprise an indication relative to a presence (e.g., a contour, or a silhouette of the microorganism) in the image of at least one given microorganism.
- the training pattern may comprise a plurality of annotations each comprising a localization in the image containing at least one given microorganism.
- the training pattern may comprise a value of one or more respective biological attributes for the at least one given microorganism.
- Each annotation may be a piece of data that represents an instantiation of a biological attribute of microorganisms present in the microscope image of the sample of microorganisms in the liquid medium.
- Each annotation may comprise a localization in the image containing at least one given microorganism.
- an annotation may comprise or consist of a label affixed or associated to the localization of the at least one given microorganism.
- Each annotation may further comprise a value of one or more respective biological attributes for the at least one given microorganism.
- the one or more biological attributes may be from any of a predetermined set of categories for the at least one given microorganism.
- an annotation of a microorganism may comprise values defining the localization in the image containing at least one given microorganism, e.g., a bounding box represented by coordinates (x, y) and size specifications of the bounding box, such as width and height, and values of one or more biological attributes (e.g., including the species of the microorganisms and or a physiological state such as a health state).
- the machine-learning method may also comprise training the neural network based on the provided dataset. As known per se from the field of machine-learning, the training proceeds to adjust the weights of the neural network according to the computed output. As known per se, the output is compared to the values of the annotations in the training samples and the weights may be adjusted according to such comparison. The performance of the accuracy due to learning may be tracked using standard machine-learning methods.
- the neural network trained by the machine-learning method thus results in an improved accuracy for analyzing samples of microorganisms in liquids.
- the output value of the one or more respective biological attributes at each localization in the image containing the at least one respective microorganism allows to make qualitative assessments on the biological status and simultaneously the health of the population of the microorganisms in the sample.
- the processing performed by the trained one or more neural networks are particularly fast, compared to a manual assessment of the health of microorganism by using prior art methods, such as high throughput sequencing methods or qPCR. Said methods may take up-to several months for obtaining results.
- the one or more neural networks trained according to the machine-learning method may process the flux of images in a much faster time, e.g., in a matter of minutes or less.
- the device may analyze, e.g., a flux of images comprising 3600 images per hour or more.
- the device allows the automation of continuous and in situ image analysis (additionally or alternatively, transmission of the analyzed images), all while maintaining the possibility of collecting other physico-chemical parameters.
- the use of the device is non-invasive and non-disruptive.
- the flux of images allows for a massive collection of data for better regular statistics and a better interpretation of the state of cultivation. Moreover, it is easy to maintain and create redundancy if needed.
- the device is configured for capturing and analyzing images of microorganisms with trained neural networks. Training of the neural networks may be performed on other dedicated resources such as high performance computers (HPC). Once the training has been carried out, which gives rise to a calibrated neural network, the system can consume this model in order to carry out an analysis of the acquired images (detection/classification of target species).
- HPC high performance computers
- the device comprises three systems, ideally independent in their construction and assembly, allowing to modulate the functions without rebuilding an entire system.
- the systems are: a fluidics system including pumps and mixers, an optical system and an electronic system.
- the three systems can be easily opened for intervention or observation.
- the three modules may be nested in the device and form a single unit (i.e., the device) when assembled.
- the optical system operates in three possible modes: transmitted light, dark field and phase contrast.
- a lighting source can be changed to an LED for fluorescence microscopy.
- the optical system includes:
- the fluidics system allows the continuous observation of solutions and which can be operated in semi-continuous mode to facilitate the observation of objects contained in the liquid.
- the device comprises a peristaltic pump for taking in liquid from the external liquid medium.
- the device comprises another peristaltic pump and a mixing system to dilute the liquid. This second pump can optionally be used to clean the fluidics system.
- the dilution is determined by measuring the turbidity of the solution using an appropriate sensor.
- the device may stop the second peristaltic pump until the fluid is stable and can be captured by the optics system with an appropriate resolution.
- the micro-channel is easily removable in case of obstruction or to cover larger species.
- the electronic system is based for example on an embedded microcontroller (or processor) of the NVIDIA Jetson type or Raspberry Pi type.
- the microcontroller allows the control of the peristaltic pumps and motors of the micro-fluidic stage by means of an additional card. Obtain the location and precise schedule of the measurements using an additional map. To obtain the measurement of the turbidity of the solution and its possible correction by means of the second peristaltic pump.
- the electronic system and the pumps operate on a 220V supply. Examples of the device are now discussed with reference to FIG.s 1 to 4.
- FIG. 1 shows an isometric view 1000 of the example of the device 10.
- the device 10 comprises a squared-shape enclosure 1001 with rounded corners, a panel for the transmission system comprising electronic connectors 1002, an ethernet connector 1003, a USB-C connector and a DC connector 1004 for powering the device.
- the ethernet connector may be used for transmitting the flux of images to a remote system.
- the device also comprises a DC 9 V connector 1005 for powering the motors that control the peristaltic pumps and a GPS antenna connector 1006.
- the device may also comprise a Wi-Fi antenna (not shown).
- the device also comprises three ports 1009-1011, and a knob 1007 for controlling the intensity of the light source in the optics system.
- the optics system 3001 comprises a micrometer stage 3009.
- the micrometer stage 3009 may be a manually operated or optionally motorized.
- the micrometer stage 3009 is configured to move the sample in a direction parallel to the optical axis. I.e. perpendicular to the sample.
- the optics system 3001 also comprises slits 3010, 3012, which are passages for a ribbon cable that connects the integrated camera (comprised in the microscope body 3013) of the microscope to the stack 3006 of the electronic system 3003.
- the optics system also comprises a clamp 3011 for the microscope body 3013.
- the microscope body 3013 is shortened by using the converging lens with focal distance of 50 mm in order to reduce the length of the tube.
- the wall 3004 also comprises ribs 3020 which maintain dimensional stability of the wall 3004, e.g., during cool down.
- the wall 3004 also comprises inlets 3021 and 3022; the inlet 3021 is attached to the liquid input port 1009, and the inlet 3022 is attached to the dilutant input port 1011, which are inputs and outputs of the microfluidic slide 3015.
- Figure 4 is another isometric view 4000 of the fluidics system 3002.
- the fluidics system 3002 includes two peristaltic pumps 4001, 4002. Each peristaltic pump is secured to the plate via T-bars 4003. The liquid containing microorganisms from the external liquid medium is taken in through the liquid input port 1009. The liquid is carried to the peristaltic pump 4001 through the liquid input channel 4005 and then exits the peristaltic pump 4001 through the tube 4006.
- the electronics system may be configured to vary the speed of the carrying of the liquid by the peristaltic pump
- the kit may be used on an industrial premise.
- FIG. 5 illustrating industrial premises 5000 in which the kit may be deployed.
- the device may be deployed on an open pond system 5001 or on a microalgae culture 5002.
- the device provides the possibility of simultaneously acquiring information on the biological quality of the culture medium and on the state of the populations of microalgae/cyanobacteria (number, diversity, physiological state) on the industrial premises 5001, 5002.
- the device allows in-situ and continuous acquisition of the various parameters. Multiple devices may be placed on different industrial premises to obtain massive data acquisition.
- FIG. 6 illustrating images 6000 captured by the optics system.
- Image 6001 is from a sample of Porphyridium.
- Image 6003 is from a sample of Nannochloropsis.
- Image 6004 is from a sample of Tetraselmis.
- Image 6005 is from a sample of Spirullin.
- the remote system may be provided on a remote location, e.g., an office or another building.
- FIG. 7 shows an example of the remote system, wherein the remote system is a client computer system, e.g. a workstation of a user.
- the remote system is a client computer system, e.g. a workstation of a user.
- the client computer of the example comprises a central processing unit (CPU) 7010 connected to an internal communication BUS 7000, random access memory (RAM) 7070 also connected to the BUS.
- the client computer is further provided with a graphical processing unit (GPU) 7110 which is associated with video random access memory 7100 connected to the BUS.
- Video RAM 7100 is also known in the art as a frame buffer.
- a mass storage device controller 7020 manages accesses to a mass memory device, such as a hard drive 7030.
- Mass memory devices suitable for tangibly embodying computer program instructions and data include all forms of nonvolatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks.
- the client computer may comprise a memory storing the computer program comprising instructions configured for causing a processor to display on a screen a graphical user interface (GUI) configured for user-interaction with the device. Any of the foregoing may be supplemented by, or incorporated in, specially designed ASICs (application-specific integrated circuits).
- a network adapter 7050 manages accesses to a network 7060.
- the client computer may communicate with the device via the network 7060.
- the client computer may send or receive instructions from the device.
- the client computer may receive the flux of images for its posterior treatment through the network adapter 7050.
- the client computer may process the flux of images from the microscope.
- the client computer may also comprise the memory having recorded thereon one or more neural networks configured for performing the detection and/or estimation.
- the client computer may also comprise applying the one or more neural networks to the flux of images so as to perform the detection and/or estimation.
- the client computer may also perform the estimation of the mass of microorganisms in the flux of images, and send instructions to the device through the network adapter 7050 for performing the variation of the proportion of dilutant in the mixture based on the estimated mass.
- the kit comprising the client computer and the device may thus form an interconnected system.
- the client computer may perform one or more functions of the processing unit so as to reduce processing load to the processing unit in the device.
- the client computer may also include a haptic device 7090 such as cursor control device, a keyboard or the like.
- a cursor control device is used in the client computer to permit the user to selectively position a cursor at any desired location on display 7080.
- the cursor control device allows the user to select various commands, and input control signals.
- the cursor control device includes a number of signal generation devices for input control signals to system.
- a cursor control device may be a mouse, the button of the mouse being used to generate the signals.
- the client computer system may comprise a sensitive pad, and/or the screen.
- the screen may be a touch sensitive screen. The screen may thus allow interaction with the interface screens of the GUI.
- the GUI may be configured for receiving the processed flux of images from the device.
- the GUI may be configured for receiving the flux of images without any processing, and performing processing on the system.
- FIG. 8 shows a screenshot 8000 of the GUI.
- the GUI is presented as an interface screen on the client computer system.
- the interface screen comprises a user-interaction section 8010 for sending instructions to the electronic system for varying the speed of the carrying of the liquid by the peristaltic pump attached to the liquid input channel.
- the interface screen also comprises a user-interaction section 8020 for sending instructions (through the network adapter) to the device, so that the electronic system varies the speed of the carrying of the dilutant by the peristaltic pump attached to the dilutant input channel.
- the interface screen also comprises an image analysis section 8030 for displaying the analyzed images.
- the image analysis section 8030 shows an image with respective bounding boxes 8040 for the detected microorganisms.
Landscapes
- Chemical & Material Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Dispersion Chemistry (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Signal Processing (AREA)
- Engineering & Computer Science (AREA)
- Apparatus Associated With Microorganisms And Enzymes (AREA)
Abstract
Description
Claims
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/IB2022/000587 WO2024079496A1 (en) | 2022-10-12 | 2022-10-12 | Device for analyzing samples of microorganisms in liquids |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4602347A1 true EP4602347A1 (en) | 2025-08-20 |
Family
ID=84535718
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP22823615.4A Withdrawn EP4602347A1 (en) | 2022-10-12 | 2022-10-12 | Device for analyzing samples of microorganisms in liquids |
Country Status (2)
| Country | Link |
|---|---|
| EP (1) | EP4602347A1 (en) |
| WO (1) | WO2024079496A1 (en) |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB201706947D0 (en) * | 2017-05-02 | 2017-06-14 | Cytosight Ltd | Fluid sample enrichment system |
| WO2021000279A1 (en) | 2019-07-03 | 2021-01-07 | Dow Silicones Corporation | Silicone pressure sensitive adhesive composition and methods for preparation and use thereof |
| US12436088B2 (en) * | 2020-11-03 | 2025-10-07 | Droplet Genomics, Uab | Integrated platform for selective microfluidic particle processing |
| EP4012381B1 (en) * | 2020-12-09 | 2025-11-26 | Wilde, Axel | Device and method for detecting particles in liquids and gases |
-
2022
- 2022-10-12 EP EP22823615.4A patent/EP4602347A1/en not_active Withdrawn
- 2022-10-12 WO PCT/IB2022/000587 patent/WO2024079496A1/en not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024079496A1 (en) | 2024-04-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Beyenal et al. | Quantifying biofilm structure: facts and fiction | |
| CN102762713B (en) | Cell Image Capture and Remote Monitoring System | |
| US20110229927A1 (en) | Sample port of a cell culture system | |
| Heins et al. | Advances in automated real‐time flow cytometry for monitoring of bioreactor processes | |
| EP2187219A1 (en) | Sample analysis system, regent preparation device, and sample treating device | |
| US20170138924A1 (en) | Automated cell culture system and corresponding methods | |
| CN116977344A (en) | A statistical method and device for density and biomass of red tide algae based on instance segmentation | |
| CN115985404A (en) | Method and apparatus for monitoring and automatically controlling a bioreactor | |
| US20210060558A1 (en) | Organism evaluation system and method of use | |
| Gincley et al. | Introducing ARTiMiS: A low-cost flow imaging microscope for microalgal monitoring | |
| CN107838054A (en) | A kind of model organism sorting unit | |
| Pollina et al. | PlanktonScope: Affordable modular imaging platform for citizen oceanography | |
| Wang et al. | Intelligent optoelectrowetting digital microfluidic system for real-time selective parallel manipulation of biological droplet arrays | |
| Gervasi et al. | Automated open-hardware multiwell imaging station for microorganisms observation | |
| Esmaeel et al. | Multi-purpose machine vision platform for different microfluidics applications | |
| WO2024079496A1 (en) | Device for analyzing samples of microorganisms in liquids | |
| US12344827B2 (en) | Automatized, programmable, high-throughput tissue culture and analysis systems and methods | |
| Gomes et al. | Frame Rhythm: A new cost-effective approach for semi-automatic microalgal imaging and enumeration | |
| Xie et al. | A robot-assisted cell manipulation system with an adaptive visual servoing method | |
| KR102390074B1 (en) | The Apparatus for Continuously Monitoring Image of Microalgae | |
| Gincley et al. | Introducing ARTiMiS: A low-cost flow imaging microscope for phytoplankton monitoring in engineered and natural environments | |
| Wang et al. | A Review of the Application of Compliance Phenomenon in Particle Separation Within Microfluidic Systems | |
| CN211402075U (en) | Micro-fluidic automatic separation and intelligent component identification system | |
| CN108802412A (en) | Microflow controlled biochip intelligence control system and control method based on the system | |
| Gincley | Advancing the State of the Art for Affordable Flow Imaging Microscopy with ARTIMIS |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20250512 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
| 18D | Application deemed to be withdrawn |
Effective date: 20251122 |