CN113358654B - Image acquisition and analysis system - Google Patents
Image acquisition and analysis system Download PDFInfo
- Publication number
- CN113358654B CN113358654B CN202110637316.1A CN202110637316A CN113358654B CN 113358654 B CN113358654 B CN 113358654B CN 202110637316 A CN202110637316 A CN 202110637316A CN 113358654 B CN113358654 B CN 113358654B
- Authority
- CN
- China
- Prior art keywords
- image
- power
- low
- main controller
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
- G01N2021/0106—General arrangement of respective parts
- G01N2021/0112—Apparatus in one mechanical, optical or electronic block
Abstract
The application discloses an image acquisition and analysis system. The system comprises: the objective table is used for bearing the cell smear; the motor control device is connected with the objective table and is used for controlling the movement of the objective table; an objective lens switching device; the microscope is connected with the objective lens conversion device; the camera is connected with the microscope and is used for shooting an image observed by the microscope; the image quality detection device is connected with the camera; the main controller is respectively connected with the image quality detection device, the objective lens conversion device and the motor control device; and an image analysis device connected with the controller. The system can automatically photograph the cell smear, analyze the image quality and adjust the illumination, thereby obtaining clear images, and can obtain complete cell smear photos through image splicing, thereby more completely and comprehensively performing image analysis.
Description
Technical Field
The present application relates to the field of automated processing technologies, and in particular, to an image acquisition and analysis system.
Background
To diagnose whether a patient suffers from or is predisposed to cancer, it is necessary to remove a cell sample from the patient and to perform a thorough analysis of the cell sample in order to assess whether abnormal or abnormal cells are present. The pathologist or other skilled medical practitioner makes a diagnosis based primarily on the specific characteristics of the cells in the sample. These cytological tests are based on the two-dimensional representation of the cells present in the sample and mostly require the immobilization of the cells on a matrix and the visualization of specific features of the cells using dyes or stains. In the prior art, although automatic processing of sampling, smear preparation or cell identification exists, the actual judgment also needs the participation of medical staff, for example, the control of a stage, the judgment of cell identification, the preparation of an analysis report and the like, and the detection efficiency and the result accuracy are influenced due to the difference of the levels of the medical staff.
Disclosure of Invention
It is an object of the present application to overcome the above problems or to at least partially solve or mitigate the above problems.
According to one aspect of the present application, there is provided an image acquisition and analysis system comprising:
the objective table is used for bearing the cell smear;
the motor control device is connected with the objective table and is used for controlling the objective table to move in a three-dimensional space;
an objective lens conversion device;
the microscope is connected with the objective lens conversion device and is used for observing the cell smear;
the camera is connected with the microscope and is used for shooting an image observed by the microscope;
the image quality detection device is connected with the camera and used for controlling shooting of the camera, receiving an image shot by the camera and detecting a defocusing measurement value and brightness of the image;
the main controller is respectively connected with the image quality detection device, the objective lens conversion device and the motor control device, is used for receiving the defocusing measurement value and the brightness of the image quality detection device to control the motor control device, and is used for controlling the objective lens conversion device to perform objective lens conversion; and
and the image analysis device is connected with the main controller and is used for receiving the images transmitted by the image quality detection device and splicing and analyzing the images.
The system can automatically photograph the cell smear through the cooperation of the microscopic imaging device and the main controller, analyzes the image quality, adjusts illumination, obtains clear images, can obtain complete cell smear pictures through image splicing, and can more completely and comprehensively perform image analysis.
Optionally, the motor control device comprises:
the transmission mechanism is used for controlling the object stage to move in a three-dimensional space;
the motor is respectively connected with the transmission mechanism and the main controller, is used for controlling the transmission mechanism, and drives the transmission mechanism based on the defocusing measurement value detected by the image quality detection device;
an LED array circuit connected to the main controller for providing illumination to the stage and varying the intensity of the illumination based on the brightness detected by the image quality detection device; and
and the limiting detection sensor is connected with the main controller and is used for detecting whether the edge of the cell smear is positioned in the visual field of the microscope.
Optionally, the image quality detection apparatus includes:
a camera driving circuit connected to the camera for driving the camera;
The image transmission circuit is connected with the camera driving circuit and used for acquiring images shot by the camera, preprocessing the images and transmitting the images to the first controller and transmitting the images to the image quality detection device through the main controller; and
the microprocessor is connected with the main controller, is respectively connected with the camera and the camera driving circuit, and is used for calculating a defocusing metric value according to images shot by the camera when the microscope is at different heights from the objective table, and sending the defocusing metric value to the main controller through the image transmission circuit, so that the main controller can control the motion of the motor control device according to the defocusing metric value; and the LED array circuit is used for calculating the brightness of the image shot by the camera and the complexity of the image, and sending the brightness and the complexity to the main controller through the image transmission circuit, so that the main controller can control the LED array circuit according to the brightness and the complexity.
Optionally, the main controller is configured to perform an initialization step, the initialization step including:
an object stage initialization step: controlling the objective lens switching device to align a low power objective lens with the objective table, and controlling the motor control device to make the objective table reach a position closest to the low power objective lens and align a scanning origin of the cell smear with the low power objective lens;
A first focus adjustment step: controlling the control motor control device to enable the objective lens to be far away from the objective lens in the vertical direction to a first preset distance, receiving a first low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the first low-power image to obtain a first defocusing metric value; controlling the control motor control device to enable the objective table to keep away from the objective lens in the vertical direction to a second preset distance, receiving a second low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the second low-power image to obtain a second defocusing metric value; when the first defocus metric value is smaller than the second defocus metric value, continuing to control the motor control device to enable the objective table to be away from the objective lens in the vertical direction and receive the low-power image obtained by shooting by the camera until the calculated defocus metric value is larger than or equal to the defocus metric value obtained by the next calculation, and taking the position with the largest defocus metric value as the focusing position; and
and a brightness adjusting step: and receiving the brightness of the image and the complexity of the image sent by the brightness detection circuit, and controlling the LED array circuit to increase the illumination intensity when the brightness of the image is less than a first threshold value and the complexity of the image is less than a second threshold value.
Optionally, after the initialization step, the main controller further performs a low-power image transmission step, where the low-power image transmission step includes:
controlling the motor control device to control the object stage at a first further distance, so that a camera shoots the cell smear according to the line and obtains a macroscopic image, and transmitting the macroscopic image, the macroscopic image number and the corresponding object stage coordinate to the image analysis device;
and under the condition that a limit detection sensor detects that the edge of the cell smear is positioned in the visual field of the microscope, receiving an edge detection signal sent by the limit detection sensor, controlling the motor control device to enable the cell smear to move for a pixel block distance in the direction vertical to the row on the horizontal plane, and then shooting the next row.
Optionally, the main controller further performs a high power image transmission step after performing the low power image transmission step, and the high power image transmission step includes:
under the condition that the image analysis device splices and analyzes all low-power images transmitted by the main controller to obtain at least one interesting low-power image, the objective lens conversion device is controlled to enable the high-power objective lens to be aligned with the objective table, and the motor control device is controlled to enable the objective table to move to an objective table coordinate position corresponding to the at least one interesting low-power image on a horizontal plane;
In the case where the camera takes a high power image of the cell smear corresponding to the at least one low power image of interest, the high power image is received and the high power image, a high power image number and corresponding stage coordinates are transmitted to the image analysis device.
Optionally, after the low-power image transmission step, the main controller further performs a high-power image transmission step, where the high-power image transmission step includes:
under the condition that the image analysis device splices and analyzes all the low-power images transmitted by the main controller to obtain at least one interested low-power image, the objective lens conversion device is controlled to enable the high-power objective lens to be aligned to the objective table, and the coordinate range of the motor control device for controlling the movement of the objective table is calculated based on the at least one interested low-power image and corresponding objective table coordinates according to the relationship between the low-power objective lens and the high-power objective lens;
controlling the motor control device to control the object stage by a second stepping distance so that the object stage moves in the coordinate range, wherein the second stepping distance is smaller than the first stepping distance;
And under the condition that the camera shoots the cell smear and obtains a high-power image, receiving the high-power image and transmitting the high-power image to the image analysis device, so that the image analysis device can splice and analyze the high-power image.
Optionally, the image analysis apparatus comprises: a memory, a processor and a display device, the processor being connected to the memory and the display device, respectively, wherein,
a database is stored in the memory, and historical images with the same source as the cell smear are stored in the database;
the processor is connected with the main controller and used for receiving the image transmitted by the image quality detection device, comparing the image with historical images in the database and judging the types of the cells in the image;
the display device is used for displaying the judgment result of the processor.
Optionally, the memory further stores a computer program executable by the processor, wherein the processor executes the computer program to implement the following steps:
low-power image splicing: and receiving the macroscopic image, the macroscopic image number and the corresponding objective table coordinate sent by the main controller, and splicing the macroscopic image into a complete macroscopic image of the cell smear according to the macroscopic image number and the corresponding objective table coordinate.
Optionally, after the low-magnification image stitching step, the processor executes the computer program to further implement the following steps:
an image segmentation step: and carrying out image segmentation and black-and-white reverse color processing on the complete low-power image, obtaining the outer contour of the region of interest through edge detection, taking the low-power image containing the outer contour as the interested low-power image, and sending the number of the interested low-power image and the corresponding objective table coordinate to the main controller.
The above and other objects, advantages and features of the present application will become more apparent to those skilled in the art from the following detailed description of specific embodiments thereof, taken in conjunction with the accompanying drawings.
Drawings
Some specific embodiments of the present application will be described in detail hereinafter by way of example and not by way of limitation with reference to the accompanying drawings. The same reference numbers in the drawings identify the same or similar elements or components. Those skilled in the art will appreciate that the drawings are not necessarily drawn to scale. In the drawings:
FIG. 1 is a schematic block diagram of an image acquisition and analysis system according to the present application;
FIG. 2 is a schematic block diagram of a motor control device of the system according to the present application;
FIG. 3 is a schematic block diagram of an image quality detection device of a system according to the present application;
fig. 4 is a schematic configuration diagram of an image analysis apparatus of the system according to the present application.
Detailed Description
The above and other objects, advantages and features of the present application will become more apparent to those skilled in the art from the following detailed description of specific embodiments thereof, as illustrated in the accompanying drawings.
Embodiments of the present application provide an image acquisition and analysis system. FIG. 1 is a schematic block diagram of an image acquisition and analysis system according to the present application. The system comprises: the objective table is used for bearing the cell smear; the motor control device is connected with the objective table and used for controlling the objective table to move in a three-dimensional space; an objective lens switching device; the microscope is connected with the objective lens conversion device and is used for observing the cell smear; the camera is connected with the microscope and is used for shooting an image observed by the microscope; the image quality detection device is connected with the camera and used for controlling shooting of the camera, receiving an image shot by the camera and detecting a defocusing measurement value and brightness of the image; the main controller is respectively connected with the image quality detection device, the objective lens conversion device and the motor control device, is used for receiving the defocusing measurement value and the brightness of the image quality detection device to control the motor control device, and is used for controlling the objective lens conversion device to perform objective lens conversion; and the image analysis device is connected with the controller and is used for receiving the image transmitted by the image quality detection device and splicing and analyzing the image.
The objective table, the motor control device, the objective lens conversion device, the microscope, the camera and the image quality detection device form a microscopic imaging device.
The system can automatically photograph the cell smear through the cooperation of the microscopic imaging device and the main controller, analyzes the image quality, adjusts the illumination, obtains clear images, can obtain complete cell smear photos through image splicing, and can perform image analysis more completely and comprehensively.
Fig. 2 is a schematic block diagram of a motor control device of the system according to the present application. Optionally, the motor control device comprises: the transmission mechanism is used for controlling the object stage to move in a three-dimensional space; the motor is respectively connected with the transmission mechanism and the main controller, is used for controlling the transmission mechanism, and drives the transmission mechanism based on the defocusing measurement value detected by the image quality detection device; an LED array circuit connected to the main controller for providing illumination to the stage and varying the intensity of the illumination based on the brightness detected by the image quality detection device; and the limit detection sensor is connected with the main controller and is used for detecting whether the edge of the cell smear is positioned in the visual field of the microscope.
Optionally, the main controller controls the programmable LED array circuit to display the required illumination intensity through the COM1 communication port; the motor is controlled through a COM2 communication port to drive the transmission mechanism to change the position of the cell smear from the microscope; the image quality detection device provides a trigger signal through the level conversion chip to trigger the camera to work. The motor control device defines a data protocol based on serial port transmission. In the LED array circuit driving data protocol, a main controller sends a control command to an LED array circuit through a COM1 communication port to control the working state of the LED array circuit, so that the LED array circuit outputs different working mode signals to a programmable LED array for display. The operation modes may include: the system comprises a dark light mode, a strong light mode, a light field mode, a differential imaging mode and a user-defined mode, wherein under the user-defined mode, the light intensity can realize multi-level conversion.
Adopt motor control device can enough control the smear position, can control illumination intensity again to can obtain clear image.
Fig. 3 is a schematic configuration diagram of an image quality detection apparatus of the system according to the present application. Optionally, the image quality detection apparatus includes: a camera driving circuit connected to the camera for driving the camera; the image transmission circuit is connected with the camera driving circuit and used for acquiring images shot by the camera, preprocessing the images and transmitting the images to the first controller and transmitting the images to the image quality detection device through the main controller; the microprocessor is connected with the main controller, is respectively connected with the camera and the camera driving circuit, and is used for calculating a defocusing metric value according to images shot by the camera when the microscope is at different heights from the objective table, and sending the defocusing metric value to the main controller through the image transmission circuit, so that the main controller can control the motion of the motor control device according to the defocusing metric value; and the LED array circuit is used for calculating the brightness of the image shot by the camera and the complexity of the image, and sending the brightness and the complexity to the main controller through the image transmission circuit, so that the main controller can control the LED array circuit according to the brightness and the complexity.
Through this image quality detection device, can carry out the analysis to the image of shooing to judge whether the light intensity of LED array circuit is suitable, thereby take out clearer image.
Optionally, the main controller is configured to perform an initialization step, the initialization step including:
stage initialization: controlling the objective lens conversion device to align a low power objective lens with the objective table, and controlling the motor control device to enable the objective table to reach the position closest to the low power objective lens and align the scanning origin of the cell smear with the low power objective lens;
a first focal length adjustment step: controlling the control motor control device to enable the objective lens to be far away from the objective lens in the vertical direction to a first preset distance, receiving a first low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the first low-power image to obtain a first defocusing metric value; controlling the control motor control device to enable the objective table to keep away from the objective lens in the vertical direction to a second preset distance, receiving a second low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the second low-power image to obtain a second defocusing metric value; when the first defocus metric value is smaller than the second defocus metric value, continuing to control the motor control device to enable the objective table to be away from the objective lens in the vertical direction and receive the low-power image obtained by shooting by the camera until the calculated defocus metric value is larger than or equal to the defocus metric value obtained by the next calculation, and taking the position with the largest defocus metric value as the focusing position; and
And a brightness adjusting step: and receiving the brightness of the image and the complexity of the image sent by the brightness detection circuit, and controlling the LED array circuit to increase the illumination intensity when the brightness of the image is less than a first threshold value and the complexity of the image is less than a second threshold value.
In the method, for a first low-magnification image shot by a camera, a defocus metric function is adopted to calculate a first defocus metric value, and the defocus metric function adopts a gray variance function of a gray gradient operator, namely, second-order partial derivatives are calculated in XY directions. The horizontal position of the objective table is unchanged, the vertical position is reduced, for a second low-power image shot by the camera, a second out-of-focus metric value is calculated by adopting an out-of-focus metric function, if the first out-of-focus metric value is smaller than the second out-of-focus metric value, the objective table is continuously reduced, the low-power image is continuously obtained, the out-of-focus metric value of the low-power image obtained each time is compared with the previous time, until the out-of-focus metric value obtained when the objective table is adjusted for a certain time is larger than the out-of-focus metric value obtained when the objective table is adjusted for the next time, the objective table is adjusted to the position of the time, focusing is finished, if the out-of-focus metric value obtained when the objective table is adjusted for a certain time is equal to the out-of-focus metric value obtained when the objective table is adjusted for the next time, and the position of the objective table at the next time is taken as the focal position.
It is understood that, in addition to using the gray variance function, the defocus metric function can be implemented using a Brenner gradient function, a Tenengrad gradient function, a Laplacian gradient function, a variance function, an energy gradient function, an entropy function, and a Vollath function.
The complexity of the image is calculated using a weighted average of the absolute values of the differences between the luminance values of the pixels of the low-magnification image and the luminance average of the low-magnification image.
The human eye is more sensitive to image quality degradation on low frequency images than high frequency images, and at the same time, images with high complexity have high spatial frequencies, and the human eye is not easily aware of the image quality degradation. As for the brightness, the eye is likely to perceive the image quality deterioration in the dark area, and is less likely to perceive the image quality deterioration in the bright area. The purpose of setting the first threshold and the second threshold is therefore to adjust the brightness of the light source taking into account the sensitivity of the human eye to the brightness and complexity of the image at the same time, so that the image is more clearly imaged.
Optionally, after the initialization step, the main controller further performs a low-power image transmission step, where the low-power image transmission step includes:
controlling the motor control device to control the object stage by a first further distance, so that a camera shoots the cell smear according to rows and obtains a low-power image, and transmitting the low-power image, the low-power image number and corresponding object stage coordinates to the image analysis device;
And under the condition that a limit detection sensor detects that the edge of the cell smear is positioned in the visual field of the microscope, receiving an edge detection signal sent by the limit detection sensor, controlling the motor control device to enable the cell smear to move for a pixel block distance in the direction vertical to the row on the horizontal plane, and then shooting the next row.
Wherein, the corresponding object stage coordinate can be calculated by the movement of the motor control device. The motor control device scans the image in a zigzag sequence, scans one line first, moves the object stage to the end of the second line, scans from the end of the second line to the starting point of the second line, moves to the third line, and so on until the scanning is finished. The limit detection sensor can be an infrared laser geminate transistor and is respectively arranged on the objective lens conversion device and a microscope support below the objective table, the middle of the general objective table is a transparent part, and the periphery of the transparent part is a non-transparent part. When the objective table moves, the infrared laser geminate transistors are relatively static. If the transparent part is positioned under the objective lens, the infrared laser geminate transistor is connected, and if the non-transparent part is positioned under the objective lens, the infrared laser geminate transistor is not connected, so that the fact that the edge of the cell smear is reached is judged. Adopt spacing detection sensor can adapt to the objective table that transparent part area is different to adapt to the cell smear of not using the size.
Optionally, after the low-power image transmission step, the main controller further performs a high-power image transmission step, where the high-power image transmission step includes:
under the condition that the image analysis device splices and analyzes all low-power images transmitted by the main controller to obtain at least one interesting low-power image, the objective lens conversion device is controlled to enable the high-power objective lens to be aligned with the objective table, and the motor control device is controlled to enable the objective table to move to an objective table coordinate position corresponding to the at least one interesting low-power image on a horizontal plane;
in the case where the camera takes a high power image of the cell smear corresponding to the at least one low power image of interest, the high power image is received and the high power image, a high power image number and corresponding stage coordinates are transmitted to the image analysis device.
And (3) obtaining a suspicious cell area in the low-power image through image analysis, and preparing to observe the suspicious area under the high-power objective lens, wherein the main controller can calculate the operation instruction of the motor and the position of the objective table required to move according to the position of the interested low-power image, so that the corresponding area on the cell smear is positioned under the high-power objective lens. Because the stepping frequency of the motor is different and the moving speed of the objective table is different under the low-power objective lens and the high-power objective lens, the main control computer can calculate the moving times, distance and moving range of the objective table according to the position of the low-power image.
Optionally, the main controller further performs a high power image transmission step after performing the low power image transmission step, and the high power image transmission step includes:
under the condition that the image analysis device splices and analyzes all the low-power images transmitted by the main controller to obtain at least one interested low-power image, the objective lens conversion device is controlled to enable the high-power objective lens to be aligned to the objective table, and the coordinate range of the motor control device for controlling the movement of the objective table is calculated based on the at least one interested low-power image and corresponding objective table coordinates according to the relationship between the low-power objective lens and the high-power objective lens;
controlling the motor control device to control the object stage by a second stepping distance so that the object stage moves in the coordinate range, wherein the second stepping distance is smaller than the first stepping distance;
and under the condition that the camera shoots the cell smear and obtains a high-power image, receiving the high-power image and transmitting the high-power image to the image analysis device so that the image analysis device can splice and analyze the high-power image.
Fig. 4 is a schematic configuration diagram of an image analysis apparatus of the system according to the present application. Optionally, the image analysis apparatus comprises: a memory, a processor and a display device, the processor being connected to the memory and the display device, respectively,
A database is stored in the memory, and historical images with the same source as the cell smear are stored in the database;
the processor is connected with the main controller and used for receiving the image transmitted by the image quality detection device, comparing the image with historical images in the database and judging the types of the cells in the image;
and the display device is used for displaying the judgment result of the processor.
For example, the source of the cell smear is plant, animal or human, and the historical image data of the cell smear before the source is stored in the database, wherein the historical image data is analyzed, and the cells are classified and counted. When the cell smear is analyzed at this time, the cell smear is compared with historical data, and the classification of the cells can be judged quickly, so that the processing and analysis speed is improved.
Optionally, the memory further stores a computer program executable by the processor, wherein the processor executes the computer program to implement the following steps:
splicing the low-power images: and receiving the macroscopic image, the macroscopic image number and the corresponding objective table coordinate sent by the main controller, and splicing the macroscopic image into a complete macroscopic image of the cell smear according to the macroscopic image number and the corresponding objective table coordinate.
Optionally, after the low-magnification image stitching step, the processor executes the computer program to further implement the following steps:
an image segmentation step: and carrying out image segmentation on the complete low-power image, carrying out black-and-white reverse color processing, obtaining the outer contour of the region of interest through edge detection, taking the low-power image containing the outer contour as the interesting low-power image, and sending the number of the interesting low-power image and the corresponding objective table coordinate to the main controller.
After the image segmentation step, the processor may further perform a feature extraction step, the image features comprising: gray scale, roundness, area, perimeter, major axis length, minor axis length, compactness, eccentricity and the like.
And (4) classification: and respectively calculating the influence factors of each characteristic by adopting a python decision tree to obtain a calculation formula of the cell, and screening out the target cell.
The image analysis device stores all target cell outputs as a first result. And comparing the data such as the number of the cells, the average area of the cells, the average gray value of the cells and the like with the historical data respectively by combining the historical data to generate a corresponding change trend chart as a second result. And generating a corresponding chart of the partial characteristic values of the image as a third diagnosis result, for example, a histogram of the cell area corresponding to the number of cells. The results are saved in a database and may be printed by a printer.
And inputting the first result, the second result and the third result into the trained artificial neural network, so as to obtain health indexes of plants, animals and human bodies. The artificial neural network is obtained by repeatedly training the neural network by using a large number of results.
The above description is only for the preferred embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (6)
1. An image acquisition and analysis system comprising:
the objective table is used for bearing the cell smear;
the motor control device is connected with the objective table and used for controlling the objective table to move in a three-dimensional space;
an objective lens conversion device;
the microscope is connected with the objective lens conversion device and is used for observing the cell smear;
the camera is connected with the microscope and is used for shooting an image observed by the microscope;
an image quality detection apparatus connected to the camera, for controlling photographing of the camera, receiving an image photographed by the camera, and detecting a defocus value and brightness of the image, the image quality detection apparatus comprising:
A camera driving circuit connected to the camera for driving the camera,
the image transmission circuit is connected with the camera driving circuit and is used for acquiring images shot by the camera, preprocessing the images and transmitting the preprocessed images to the first controller to be transmitted to the image quality detection device through the main controller,
the microprocessor is connected with the main controller, respectively connected with the camera and the camera driving circuit, and used for calculating an out-of-focus measurement value according to images shot by the camera when the microscope is at different heights from the object stage, and sending the out-of-focus measurement value to the main controller through the image transmission circuit, so that the main controller can control the movement of the motor control device according to the out-of-focus measurement value; the system comprises a main controller, an image transmission circuit, an LED array circuit and an LED driving circuit, wherein the main controller is used for calculating the brightness and the complexity of an image shot by a camera and sending the brightness and the complexity to the main controller through the image transmission circuit so that the main controller can control the LED array circuit according to the brightness and the complexity;
the main controller is respectively connected with the image quality detection device, the objective lens conversion device and the motor control device, and is used for receiving the defocusing measurement value and the brightness of the image quality detection device so as to control the motor control device and controlling the objective lens conversion device to carry out objective lens conversion; and
The image analysis device is connected with the main controller and is used for receiving the images transmitted by the image quality detection device and splicing and analyzing the images;
the main controller is configured to perform an initialization step, the initialization step including:
an object stage initialization step: controlling the objective lens switching device to align a low power objective lens with the objective table, and controlling the motor control device to make the objective table reach a position closest to the low power objective lens and align a scanning origin of the cell smear with the low power objective lens;
a first focus adjustment step: controlling the motor control device to enable the objective lens to be far away from the objective lens in the vertical direction to a first preset distance, receiving the first low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the first low-power image to obtain a first defocusing metric value; controlling the motor control device to enable the objective table to keep away from the objective lens in the vertical direction to a second preset distance, receiving the second low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the second low-power image to obtain a second out-of-focus measuring value; when the first out-of-focus measurement value is smaller than the second out-of-focus measurement value, continuing the motor control device to enable the objective table to be away from the objective lens in the vertical direction and receive the low-magnification image shot by the camera until the calculated out-of-focus measurement value is larger than or equal to the out-of-focus measurement value obtained by the next calculation, and taking the position with the largest out-of-focus measurement value as a focusing position; and
And a brightness adjusting step: receiving the brightness of the image and the complexity of the image sent by a brightness detection circuit, and controlling an LED array circuit to increase the illumination intensity under the condition that the brightness of the image is smaller than a first threshold and the complexity of the image is smaller than a second threshold, wherein the first threshold and the second threshold are set to adjust the brightness of a light source by simultaneously considering the sensitivity of human eyes to the brightness and the complexity of the image, so that the image is clearer;
calculating the complexity of the image by adopting a weighted average value of an absolute value of a difference between a brightness value of a pixel of a low-power image and a brightness average value of the low-power image;
after the main controller executes the initialization step, the main controller also executes a low-power image transmission step, and the low-power image transmission step comprises the following steps:
controlling the motor control device to control the object stage by a first further distance, so that a camera shoots the cell smear according to rows and obtains a low-power image, and transmitting the low-power image, the low-power image number and corresponding object stage coordinates to the image analysis device;
and under the condition that a limit detection sensor detects that the edge of the cell smear is positioned in the visual field of the microscope, receiving an edge detection signal sent by the limit detection sensor, controlling the motor control device to enable the cell smear to move for a pixel block distance in the direction vertical to the row on the horizontal plane, and then shooting the next row.
2. The system of claim 1, wherein the main controller further performs a high power image transferring step after performing the low power image transferring step, the high power image transferring step comprising:
under the condition that the image analysis device splices and analyzes all the low-power images transmitted by the main controller to obtain at least one interesting low-power image, the objective lens conversion device is controlled to align the high-power objective lens with the objective table, and the motor control device is controlled to move the objective table to a position of an objective table coordinate corresponding to the at least one interesting low-power image on a horizontal plane;
in the case where the camera takes a high power image of the cell smear corresponding to the at least one low power image of interest, the high power image is received and the high power image, a high power image number and corresponding stage coordinates are transmitted to the image analysis device.
3. The system of claim 2, wherein the main controller further performs a high power image transferring step after performing the low power image transferring step, the high power image transferring step comprising:
Under the condition that the image analysis device splices and analyzes all the low-power images transmitted by the main controller to obtain at least one interested low-power image, the objective lens conversion device is controlled to enable the high-power objective lens to be aligned to the objective table, and the coordinate range of the motor control device for controlling the movement of the objective table is calculated based on the at least one interested low-power image and the corresponding objective table coordinate according to the relation between the low-power objective lens and the high-power objective lens;
controlling the motor control device to control the object stage by a second stepping distance so that the object stage moves in the coordinate range, wherein the second stepping distance is smaller than the first stepping distance;
and under the condition that the camera shoots the cell smear and obtains a high-power image, receiving the high-power image and transmitting the high-power image to the image analysis device, so that the image analysis device can splice and analyze the high-power image.
4. The system of claim 3, wherein the image analysis device comprises: a memory, a processor and a display device, the processor being connected to the memory and the display device, respectively,
A database is stored in the memory, and historical images with the same source as the cell smear are stored in the database;
the processor is connected with the main controller and used for receiving the image transmitted by the image quality detection device, comparing the image with historical images in the database and judging the types of cells in the image;
the display device is used for displaying the judgment result of the processor.
5. The system of claim 4, wherein the memory further stores a computer program executable by the processor, wherein the processor, when executing the computer program, performs the steps of:
low-power image splicing: and receiving the macroscopic image, the macroscopic image number and the corresponding objective table coordinate sent by the main controller, and splicing the macroscopic image into a complete macroscopic image of the cell smear according to the macroscopic image number and the corresponding objective table coordinate.
6. The system of claim 5, wherein after the low power image stitching step, the processor when executing the computer program further performs the steps of:
An image segmentation step: and carrying out image segmentation on the complete low-power image, carrying out black-and-white reverse color processing, obtaining the outer contour of the region of interest through edge detection, taking the low-power image containing the outer contour as the interesting low-power image, and sending the number of the interesting low-power image and the corresponding objective table coordinate to the main controller.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110637316.1A CN113358654B (en) | 2018-07-05 | 2018-07-05 | Image acquisition and analysis system |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110637316.1A CN113358654B (en) | 2018-07-05 | 2018-07-05 | Image acquisition and analysis system |
| CN201810732860.2A CN108918519B (en) | 2018-07-05 | 2018-07-05 | Cell smear image acquisition and analysis system |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810732860.2A Division CN108918519B (en) | 2018-07-05 | 2018-07-05 | Cell smear image acquisition and analysis system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113358654A CN113358654A (en) | 2021-09-07 |
| CN113358654B true CN113358654B (en) | 2022-07-19 |
Family
ID=64424360
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810732860.2A Active CN108918519B (en) | 2018-07-05 | 2018-07-05 | Cell smear image acquisition and analysis system |
| CN202110638630.1A Pending CN113406076A (en) | 2018-07-05 | 2018-07-05 | Smear image acquisition and analysis system |
| CN202110637316.1A Active CN113358654B (en) | 2018-07-05 | 2018-07-05 | Image acquisition and analysis system |
Family Applications Before (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810732860.2A Active CN108918519B (en) | 2018-07-05 | 2018-07-05 | Cell smear image acquisition and analysis system |
| CN202110638630.1A Pending CN113406076A (en) | 2018-07-05 | 2018-07-05 | Smear image acquisition and analysis system |
Country Status (1)
| Country | Link |
|---|---|
| CN (3) | CN108918519B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110542687A (en) * | 2019-07-02 | 2019-12-06 | 中国工程物理研究院激光聚变研究中心 | Detection device and detection method for appearance defects of microscopic elements |
| CN110766668B (en) * | 2019-10-11 | 2023-09-05 | 武汉兰丁智能医学股份有限公司 | Cell detection and identification system and method |
| WO2021135393A1 (en) * | 2019-12-31 | 2021-07-08 | 深圳迈瑞生物医疗电子股份有限公司 | Image analysis apparatus and imaging method thereof |
| CN113066121A (en) * | 2019-12-31 | 2021-07-02 | 深圳迈瑞生物医疗电子股份有限公司 | Image analysis system and method for identifying repeat cells |
| CN112469984B (en) * | 2019-12-31 | 2024-04-09 | 深圳迈瑞生物医疗电子股份有限公司 | Image analysis device and imaging method thereof |
| CN111275630B (en) * | 2020-01-07 | 2022-07-26 | 中国人民解放军陆军军医大学第二附属医院 | Cell image adjusting method and device and electron microscope |
| CN112501271B (en) * | 2020-11-19 | 2022-09-02 | 武汉华大智造科技有限公司 | Slide platform leveling method, detection device and storage medium |
| CN114280769A (en) * | 2020-12-28 | 2022-04-05 | 深圳同舟光电科技有限公司 | High-sensitivity optical imaging system, method and device |
| CN114152610B (en) * | 2021-11-02 | 2023-06-27 | 桂林优利特医疗电子有限公司 | Slide cell scanning method based on visual target mark |
| CN114255334B (en) * | 2021-12-13 | 2022-08-30 | 中国中医科学院中药研究所 | Shape feature acquisition device, database and identification system for traditional Chinese medicine |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004350179A (en) * | 2003-05-26 | 2004-12-09 | Funai Electric Co Ltd | Liquid crystal television, and method, device, and program of controlling back light |
| CN101895758A (en) * | 2010-07-23 | 2010-11-24 | 南京信息工程大学 | H.264 code rate control method based on frame complexity |
| CN101976332A (en) * | 2010-11-10 | 2011-02-16 | 中国船舶重工集团公司第七一○研究所 | Finger vein collection and identification method by means of multi-features |
| CN102370452A (en) * | 2011-10-13 | 2012-03-14 | 深圳市理邦精密仪器股份有限公司 | Method and device for automatically adjusting brightness of light source of electronic colposcope |
| CN105699381A (en) * | 2016-03-28 | 2016-06-22 | 成都唐源电气有限责任公司 | Rail fastener detection device based on machine vision |
| CN105794196A (en) * | 2013-10-21 | 2016-07-20 | 诺基亚技术有限公司 | Method, apparatus and computer program product for modifying illumination in an image |
Family Cites Families (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1180437A (en) * | 1995-03-31 | 1998-04-29 | 宝丽来公司 | Brightness adjustement of images using digital scene analysis |
| JP4223778B2 (en) * | 2001-10-01 | 2009-02-12 | Ｈｏｙａ株式会社 | Automatic dimming device for endoscope and electronic endoscope device |
| CN100568926C (en) * | 2006-04-30 | 2009-12-09 | 华为技术有限公司 | The preparation method of automatic exposure control parameter and control method and imaging device |
| CN101227615A (en) * | 2007-01-19 | 2008-07-23 | 硕颉科技股份有限公司 | Image processing method |
| CN101221118A (en) * | 2007-12-07 | 2008-07-16 | 东华大学 | System and method for intelligent recognizing and counting sputum smear micro-image tubercle bacillus |
| CN101339185B (en) * | 2008-06-23 | 2011-03-02 | 武汉呵尔医疗科技发展有限公司 | Automatic microscopic imager for detecting cast-off cells and detection method |
| KR101547556B1 (en) * | 2009-02-06 | 2015-08-26 | 삼성전자주식회사 | Image display method and apparatus |
| CN101706609B (en) * | 2009-11-23 | 2012-05-02 | 常州超媒体与感知技术研究所有限公司 | Image processing based fast automatic focusing method of microscope |
| CN102304472A (en) * | 2011-05-18 | 2012-01-04 | 东华大学 | Device and method for detecting sputum smear tubercle bacillus quickly |
| CN202141852U (en) * | 2011-07-19 | 2012-02-08 | 浙江格林蓝德信息技术有限公司 | Microscope device for full-view micro image shooting |
| JP6063642B2 (en) * | 2012-05-18 | 2017-01-18 | オリンパス株式会社 | Photodetector |
| CN203054335U (en) * | 2013-01-16 | 2013-07-10 | 四川美生科技有限公司 | Microscope with automatic objective lens conversion device |
| CN103531174B (en) * | 2013-10-29 | 2017-12-08 | 京东方科技集团股份有限公司 | Brightness adjusting device and method |
| CN105788562B (en) * | 2014-12-24 | 2018-05-08 | Tcl集团股份有限公司 | The brightness control method and system of a kind of display device |
| CN204790173U (en) * | 2015-06-25 | 2015-11-18 | 长沙协大生物科技有限公司 | Full -automatic operation microscope |
| CN105988209B (en) * | 2016-07-12 | 2018-09-18 | 江苏赛尔蒂扶医疗科技有限公司 | One kind being based on microscopical automatic detection system |
| KR102588126B1 (en) * | 2016-11-01 | 2023-10-13 | 삼성전자주식회사 | Display driver integrated circuit and display driving system including the same |
| CN206557467U (en) * | 2017-03-28 | 2017-10-13 | 湖南省天骑医学新技术股份有限公司 | A kind of automated optical microscopic system |
| CN106990518A (en) * | 2017-04-17 | 2017-07-28 | 深圳大学 | A kind of blood film self-focusing micro imaging method |
-
2018
- 2018-07-05 CN CN201810732860.2A patent/CN108918519B/en active Active
- 2018-07-05 CN CN202110638630.1A patent/CN113406076A/en active Pending
- 2018-07-05 CN CN202110637316.1A patent/CN113358654B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004350179A (en) * | 2003-05-26 | 2004-12-09 | Funai Electric Co Ltd | Liquid crystal television, and method, device, and program of controlling back light |
| CN101895758A (en) * | 2010-07-23 | 2010-11-24 | 南京信息工程大学 | H.264 code rate control method based on frame complexity |
| CN101976332A (en) * | 2010-11-10 | 2011-02-16 | 中国船舶重工集团公司第七一○研究所 | Finger vein collection and identification method by means of multi-features |
| CN102370452A (en) * | 2011-10-13 | 2012-03-14 | 深圳市理邦精密仪器股份有限公司 | Method and device for automatically adjusting brightness of light source of electronic colposcope |
| CN105794196A (en) * | 2013-10-21 | 2016-07-20 | 诺基亚技术有限公司 | Method, apparatus and computer program product for modifying illumination in an image |
| CN105699381A (en) * | 2016-03-28 | 2016-06-22 | 成都唐源电气有限责任公司 | Rail fastener detection device based on machine vision |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108918519B (en) | 2021-04-27 |
| CN108918519A (en) | 2018-11-30 |
| CN113358654A (en) | 2021-09-07 |
| CN113406076A (en) | 2021-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113358654B (en) | Image acquisition and analysis system | |
| US11594024B2 (en) | Augmented reality microscope for pathology | |
| US10101572B2 (en) | Variable focal length lens system with multi-level extended depth of field image processing | |
| US10444486B2 (en) | Systems and methods for detection of blank fields in digital microscopes | |
| CN109085113B (en) | Automatic focusing method and device for cervical exfoliated cell detection device | |
| US7876948B2 (en) | System for creating microscopic digital montage images | |
| CN106210520B (en) | A kind of automatic focusing electronic eyepiece and system | |
| CN106707448B (en) | Adjusting system and adjusting method for lens assembly and display module | |
| WO2015007697A1 (en) | Auto-focus methods and systems for multi-spectral imaging | |
| JP2016125913A (en) | Image acquisition device and control method of image acquisition device | |
| CA3061440C (en) | Optical scanning arrangement and method | |
| US10613313B2 (en) | Microscopy system, microscopy method, and computer-readable recording medium | |
| CN111399208B (en) | Focusing shooting implementation method of biological fluorescence sample, microscope and storage medium | |
| CN112150446A (en) | Microscope examination and film reading scanning method, computer equipment and system | |
| US20180338079A1 (en) | Microscope system, control method, and computer readable medium | |
| CN111240004A (en) | System and method for automatically identifying two insects by microscope | |
| CN111474103A (en) | Automatic focusing scanning method and system for bone marrow cell glass slide | |
| CN112308014A (en) | High-speed accurate searching and positioning method for reflective points of pupils and cornea of eyes | |
| JP4779149B2 (en) | Operating method of laser scanning microscope | |
| CN116243451A (en) | Focusing adjustment method and device | |
| CN209803001U (en) | Chromosome scanning imaging system | |
| KR101517554B1 (en) | Control method for color lighting of vision system by conjugate gradient algorithm | |
| CN111951261A (en) | Control method, computer device and control system for in-vitro biological sample examination process | |
| JP2015102694A (en) | Alignment device, microscopic system, alignment method, and alignment program | |
| KR101469616B1 (en) | Control method for color lighting of vision system by newton's method algorithm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |