CN110927158A - Image acquisition method and device, microscope system and computer readable storage medium - Google Patents
Image acquisition method and device, microscope system and computer readable storage medium Download PDFInfo
- Publication number
- CN110927158A CN110927158A CN201911053239.4A CN201911053239A CN110927158A CN 110927158 A CN110927158 A CN 110927158A CN 201911053239 A CN201911053239 A CN 201911053239A CN 110927158 A CN110927158 A CN 110927158A
- Authority
- CN
- China
- Prior art keywords
- image
- target
- sample
- focal plane
- objective lens
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Microscoopes, Condenser (AREA)
Abstract
The application provides an image acquisition method, an image acquisition device, a microscope system and a computer readable storage medium, which are applied to the microscope system, wherein the method comprises the following steps: when the sample to be detected is of a preset sample type, controlling an objective lens to collect a first image of the sample to be detected on a fitting focal plane, wherein the first image comprises a target main body; controlling the objective lens to respectively acquire a second image of the sample to be detected on a plurality of parallel preset planes, wherein the plurality of preset planes are intersected with the fitting focal plane; and carrying out image fusion on the plurality of second images to obtain a target image, wherein the target image comprises the target subject. According to the method, the second images are collected on the plurality of preset planes intersected with the fitting focal plane, the plurality of second images are fused to obtain the target image, the target image after the plurality of second images are fused is used as the microscopic examination image, the microscopic examination image quality can be improved, the microscopic examination efficiency is improved, and the probability of missed examination of the target main body is reduced.
Description
Technical Field
The present application relates to the field of sample identification and image processing technologies, and in particular, to an image acquisition method and apparatus, a microscope system, and a computer-readable storage medium.
Background
In the process of disease diagnosis and scientific research, a specimen to be detected is often required to be sampled and filmed, a microscopic examination method is adopted to observe, analyze and judge a sample image under a high-power or low-power microscope, and a microscopic examination result of sample identification is provided. Human excreta, secretions, exfoliated cells or human tissues, animal tissues, and even plant cells can be used as objects for microscopic examination.
However, due to the reasons that the processing precision of the sample container is not flat enough, the counting plate and the blood smear are placed obliquely, and the sample container shakes during the mechanical transmission process, the target bodies in all the visual field areas are not necessarily on the same preset plane, and the operation difficulty of compensating for the fine errors of the sample container by adjusting the height of the objective table or the objective lens is high, so that the quality of the acquired microscopic image is poor, and the probability of target omission is high.
Disclosure of Invention
The embodiment of the application provides an image acquisition method, an image acquisition device, a microscope system and a computer readable storage medium, which can improve the quality of microscopic examination images and reduce the probability of target omission.
An image acquisition method applied to a microscope system including an objective lens, the method comprising:
when a sample to be detected is of a preset sample type, controlling an objective lens to collect a first image of the sample to be detected on a fitting focal plane, wherein the first image comprises a target main body;
controlling the objective lens to respectively acquire a second image of the sample to be detected on a plurality of parallel preset planes, wherein the plurality of preset planes are intersected with the fitting focal plane;
and carrying out image fusion on the plurality of second images to obtain a target image, wherein the target image comprises the target subject.
In one embodiment, the fitting focal plane is an inclined plane, the Z-axis coordinate of the fitting focal plane in a field of view of the objective lens includes a maximum Z-axis coordinate and a minimum Z-axis coordinate, the preset plane is a horizontal plane, the preset planes at least include a maximum horizontal plane and a minimum horizontal plane, and the objective lens is controlled to respectively acquire one second image in the preset planes, including:
and controlling the objective lens to respectively acquire a second image on a plurality of horizontal planes, wherein the Z-axis coordinate of the highest horizontal plane is greater than or equal to the maximum Z-axis coordinate of the fitting focal plane, and the Z-axis coordinate of the lowest horizontal plane is less than or equal to the minimum Z-axis coordinate of the fitting focal plane within a visual field range of the objective lens.
In one embodiment, the distance between any two adjacent preset planes is a first step length, and the method further includes:
acquiring a first number of the target subjects in the first image and acquiring a second number of the target subjects in the target image;
when the second number is lower than the first number, reducing the first step length, and resetting a plurality of preset planes according to the reduced first step length;
and controlling the objective lens to respectively collect a second image of the sample to be detected on the reset preset planes, and carrying out image fusion on the second images to update the target image.
In one embodiment, the image fusing the plurality of second images to obtain the target image includes:
acquiring the definition of the target subject in each second image;
and carrying out image fusion on at least two second images corresponding to the target subject with the definition higher than the threshold value so as to obtain the target image.
In one embodiment, the controlling the objective lens to acquire the first image of the sample to be measured on the fitted focal plane includes:
dividing the sample to be detected in the fitting focal plane into a plurality of visual field areas;
and controlling the objective lens to collect each field of view region on the fitting focal plane according to a preset path so as to acquire the first image.
In one embodiment, before controlling the objective lens to acquire the first image of the entire image acquisition area of the sample to be measured on the fitted focal plane, the method further includes:
acquiring at least three areas to be focused of the sample to be measured in a plane to be focused, and acquiring the position and the focal length of each area to be focused, wherein the at least three areas to be focused are not on the same straight line;
and determining the fitted focal plane according to the positions and focal lengths of at least three regions to be focused.
In one embodiment, the determining the fitted focal plane according to the positions and focal lengths of at least three regions to be focused includes: and fitting the fitted focal plane according to the positions and focal lengths of at least three regions to be focused based on a least square method.
An image acquisition device applied to a microscope system, the device comprising:
the device comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for controlling an objective lens to acquire a first image of a sample to be detected on a fitting focal plane when the sample to be detected is a preset sample type, and the first image comprises a target main body;
the second acquisition module is used for controlling the objective lens to respectively acquire a second image of the sample to be detected on a plurality of parallel preset planes, and the plurality of preset planes are intersected with the fitting focal plane;
and the acquisition module is used for carrying out image fusion on the plurality of second images so as to acquire a target image, wherein the target image comprises the target main body.
A microscope system comprising a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, causes the processor to carry out the steps of the image acquisition method as described.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method as described.
The image acquisition method and device, the microscope system and the computer-readable storage medium are applied to the microscope system, the microscope system comprises an objective lens, and the method comprises the following steps: when a sample to be detected is of a preset sample type, controlling an objective lens to collect a first image of the sample to be detected on a fitting focal plane, wherein the first image comprises a target main body; controlling the objective lens to respectively acquire a second image of the sample to be detected on a plurality of parallel preset planes, wherein the plurality of preset planes are intersected with the fitting focal plane; and carrying out image fusion on the plurality of second images to obtain a target image, wherein the target image comprises the target subject. According to the method, the second images are collected on the plurality of preset planes intersected with the fitting focal plane, the plurality of second images are fused to obtain the target image, the target image after the plurality of second images are fused is used as the microscopic examination image, the microscopic examination image quality can be improved, the microscopic examination efficiency is improved, and the probability of missed examination of the target main body is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a diagram of an exemplary environment in which an image capture method may be implemented;
FIG. 2 is a flow diagram of a method of image acquisition in one embodiment;
FIG. 3 is a flow chart of a method of image acquisition in yet another embodiment;
FIG. 4 is a flowchart illustrating steps performed in one embodiment to perform image fusion on a plurality of second images to obtain a target image;
FIG. 5 is a flowchart illustrating steps in one embodiment for controlling an objective lens to capture a first image of a sample to be measured at a fitted focal plane;
FIG. 6 is a block diagram of an embodiment of an image capturing device;
fig. 7 is a schematic view of the internal structure of the microscope system in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, a first image may be referred to as a second image, and similarly, a second image may be referred to as a first image, without departing from the scope of the present application. The first image and the second image are both images, but they are not the same image.
Fig. 1 is a schematic diagram of an application environment of an image acquisition method in an embodiment. The image capturing method provided by the present application is applied to a microscope system, as shown in fig. 1, the microscope system 10 includes an objective lens 110, and the image capturing method includes: and when the sample to be detected is of a preset sample type, controlling the objective lens to collect a first image of the sample to be detected on the fitting focal plane, wherein the first image comprises a target main body. And controlling the objective lens to respectively acquire a second image of the sample to be detected on a plurality of mutually parallel preset planes, wherein the plurality of preset planes are intersected with the fitting focal plane. And carrying out image fusion on the plurality of second images to obtain a target image, wherein the target image comprises a target main body. According to the method, the second images are collected on the plurality of preset planes intersected with the fitting focal plane, the plurality of second images are fused to obtain the target image, the target image after the plurality of second images are fused is used as the microscopic examination image, the microscopic examination image quality can be improved, the microscopic examination efficiency is improved, and the probability of missed examination of the target main body is reduced.
Fig. 2 is a flowchart of an image capturing method in an embodiment, as shown in fig. 2, the image capturing method is applied to a microscope system, and includes steps 202 to 206.
The sample type may be set according to the form or concentration of the sample to be detected, and for example, the sample type may include: blood samples, secretion samples, urine samples, stool samples, and the like. The fitting focal plane refers to a plane which is fitted according to the corresponding relation between the position and the focal length of each focusing area of the sample to be measured, and a sample image comprising most of target main bodies can be acquired on the fitting focal plane.
Specifically, the sample type of the sample to be detected is obtained by identifying a label on the sample container through a lens; and the morphological characteristic parameters of the sample to be detected can be subjected to image recognition. When the sample to be detected is a blood sample, the objective lens can acquire a first image on the fitting focal plane by adjusting the height of the objective table of the microscope system, wherein the first image comprises a target main body of the sample to be detected. For example, the sample to be tested is a blood smear, and the target subject of the sample to be tested is red blood cells, the objective lens collects a first image on the preset fitting focal plane, wherein the first image includes at least one red blood cell.
And 204, controlling the objective lens to respectively acquire a second image of the sample to be detected on a plurality of mutually parallel preset planes, wherein the plurality of preset planes are intersected with the fitting focal plane.
The fitting focal plane can be a horizontal plane or an inclined plane, and a plurality of mutually parallel preset planes are intersected with the focal plane. When the fitting intersection plane is a horizontal plane, the plurality of mutually parallel preset planes are all inclined planes; when the fitting intersection plane is an inclined plane, the plurality of mutually parallel preset planes are inclined planes intersecting with the fitting focal plane, or the plurality of mutually parallel preset planes are all horizontal planes. In addition, the distances between the plurality of preset planes parallel to each other may be the same or different, and are not limited herein.
Specifically, the objective lens is controlled to respectively collect one second image on each preset plane, namely the number of the collected second images is the same as that of the preset planes. The plurality of second images acquired may be such that there is no target subject present in one or more of the second images. Preferably, the second image without the target subject may be filtered, and at least two second images including the target subject are used for image fusion to obtain the target image.
And step 206, carrying out image fusion on the plurality of second images to obtain a target image, wherein the target image comprises a target main body. .
The fusion processing is an operation of generating a final image from a plurality of frames of images according to a certain rule. The microscope system can perform fusion processing on the obtained at least two second images to obtain a target image.
Specifically, the target image is obtained by performing fusion processing on the plurality of second images by using a tone mapping algorithm, a contrast or gradient threshold-based method, or the like. Optionally, the microscope system may further align the plurality of second images before the fusion process, so as to avoid a ghost phenomenon and improve the quality of the images. After the target image is obtained, the target main body in the target image can be identified, and the detection result of the sample to be detected is obtained from the target image. The detection result may include information such as name, kind, size, number, form, etc. of the target subject.
The image acquisition method is applied to a microscope system and comprises the following steps: and when the sample to be detected is of a preset sample type, controlling the objective lens to collect a first image of the sample to be detected on the fitting focal plane, wherein the first image comprises a target main body. And controlling the objective lens to respectively acquire a second image of the sample to be detected on a plurality of mutually parallel preset planes, wherein the plurality of preset planes are intersected with the fitting focal plane. And carrying out image fusion on the plurality of second images to obtain a target image, wherein the target image comprises a target main body. According to the method, the second images are collected on the plurality of preset planes intersected with the fitting focal plane, the plurality of second images are fused to obtain the target image, the target image after the plurality of second images are fused is used as the microscopic examination image, the microscopic examination image quality can be improved, the microscopic examination efficiency is improved, and the probability of missed examination of the target main body is reduced.
In one embodiment, the fitting focal plane is an inclined plane, the Z-axis coordinate of the fitting focal plane in a field of view of the objective lens includes a maximum Z-axis coordinate and a minimum Z-axis coordinate, the preset plane is a horizontal plane, the plurality of preset planes at least include a highest horizontal plane and a lowest horizontal plane, and the objective lens is controlled to respectively acquire a second image on the plurality of preset planes, including: and controlling the objective lens to respectively acquire a second image on a plurality of horizontal planes, wherein the Z-axis coordinate of the highest horizontal plane is greater than or equal to the maximum Z-axis coordinate of the fitting focal plane and the Z-axis coordinate of the lowest horizontal plane is less than or equal to the minimum Z-axis coordinate of the fitting focal plane within a visual field range of the objective lens.
Specifically, the fitting focal plane is an inclined plane, a plurality of parallel preset planes are arranged to be a plurality of parallel horizontal planes, and the objective lens is controlled to respectively acquire a second image on the plurality of parallel horizontal planes. It should be noted that, in a field of view of the objective lens, since the fitting focal plane is an inclined plane, the Z-axis coordinates of the fitting focal plane in the cartesian coordinate system are not identical, including the maximum Z-axis coordinate and the minimum Z-axis coordinate. In addition, the preset plurality of levels at least include a highest level and a lowest level. And the Z-axis coordinate of the set highest horizontal plane is greater than or equal to the maximum Z-axis coordinate of the fitting focal plane, and the Z-axis coordinate of the set lowest horizontal plane is less than or equal to the minimum Z-axis coordinate of the fitting focal plane. The objective lens is controlled to respectively acquire a second image on a plurality of preset horizontal planes including the highest horizontal plane and the lowest horizontal plane, so that the second images can cover more target bodies, and the target bodies at the boundary of the fitted focal plane are prevented from being missed to be detected. After the target image is obtained, the target subject in the target image can be identified, and the detection result of the sample to be detected is obtained from the target image. The detection result may include information such as name, kind, size, number, form, etc. of the target subject.
Fig. 3 is a flowchart of an image capturing method in another embodiment, in which, as shown in fig. 3, a distance between any two adjacent preset planes is a first step length, and the method further includes: step 302 to step 306.
Specifically, the target subject in the first image is identified according to the features of the target subject, such as size and shape, and the number of the target subjects in the first image is calculated and recorded as the first number. In addition, each target subject in the first image may be detected, and the target subjects whose sharpness values are greater than the first sharpness threshold may be accumulated to obtain the first number. And identifying the target subject in the target image according to the characteristics of the target subject such as size, shape and the like, and calculating the number of the target subjects in the target image and recording the number as a second number. In addition, each target subject in the first image may be detected, and the target subjects whose sharpness values are greater than the second sharpness threshold may be accumulated to obtain the second number. It should be noted that the set second definition threshold is greater than or equal to the first definition threshold to improve the quality of the target image, and the specific numerical values of the first definition threshold and the second definition threshold can be set by an engineer according to actual requirements, which is not repeated here.
And 304, when the second number is lower than the first number, reducing the first step length, and resetting a plurality of preset planes according to the reduced first step length.
Specifically, if it is detected that the second number is lower than the first number, it indicates that the number of target subjects in the target image is relatively small, and the specular inspection result is poor if the target image is correspondingly used as a specular inspection image. When the number of the target subjects in the target image is smaller, the number of the target subjects in the second image for fusing the target image is smaller, and the distance between the preset planes is correspondingly adjusted, so that the acquisition density and the acquisition number in the unit space are improved. For example, if the intervals between the plurality of mutually parallel preset planes are equal to the first step length, when the number of the target subjects in the target image is lower, the first step length is correspondingly reduced, and the plurality of mutually parallel preset planes are rearranged by taking the reduced first step length as the interval between any two adjacent preset planes.
And step 306, controlling the objective lens to respectively collect second images of the sample to be detected on the reset preset planes, and carrying out image fusion on the second images to update the target image.
Specifically, the objective lens is controlled to respectively acquire a second image on a plurality of preset planes which are parallel to each other and are reset, and the plurality of second images acquired again are subjected to image fusion to acquire a target image. And detecting the number of the target subjects in the re-acquired target image and recording the number as a third number. If the third number is larger than the first number, the image quality of the target image is superior to that of the first image, and the target image can be used as a microscopic image; and if the third number is lower than the first number, continuously reducing the distance between any two adjacent surfaces of the preset parallel surfaces until the third number corresponding to the fused target image is larger than the first number corresponding to the first image.
FIG. 4 is a flowchart illustrating steps performed in one embodiment to perform image fusion on a plurality of second images to obtain a target image. As shown in fig. 4, the image fusion of the plurality of second images to obtain the target image includes: step 402 to step 404.
And 402, acquiring the definition of the target subject in each second image.
Specifically, the target subject in each second image may be identified according to the morphological parameters of the target subject, and the coordinates of the position area where the target subject is located in each second image may be determined, so as to obtain the position area where the target subject is located in each second image. The position area may be a regular pattern covering the target body, such as a square, rectangle, circle, or the like, or an irregular area outlined according to the contour of the target body. And acquiring the definition value of the target main body in each second image according to a plurality of pixel points in the position area where the target main body is located in each second image. The process may be, for example: in each second image, taking the square sum of the gray differences of two adjacent pixels in the position area where the target subject is located as the definition of the target subject in each second image by using a Brenner gradient function; the Tenengrad gradient function can also adopt a Sobel operator to respectively extract gradient values in the horizontal direction and the vertical direction in a position area where each second image target body is located as definition values of the target body, and the higher the gradient value is, the clearer the corresponding image area is; the index of the definition measurement can also be the average gray value of the image processed by the Sobel operator, and the larger the average gray value of the image is, the clearer the image is. The above description is for illustration purposes only, and the definition value acquisition manner illustrated herein is not limited to the embodiment of the present application.
And step 404, performing image fusion on at least two second images corresponding to the target subject with the definition higher than the threshold value to obtain a target image.
Specifically, the definition value of the target subject in each second image is calculated, the second images are sorted according to the definition value of the target subject, the images with the definition of the target subject lower than the threshold value are filtered, and at least two second images with the definition of the target subject higher than the threshold value are subjected to image fusion to obtain the target images. And after the target image is obtained, identifying a target main body in the target image, namely identifying the detection result of the sample to be detected according to the target image. The detection result may include information such as name, type, size, number, and form of the target subject, and is not limited herein.
FIG. 5 is a flowchart illustrating steps in one embodiment for controlling an objective lens to capture a first image of a sample to be measured at a fitted focal plane. As shown in fig. 5, controlling the objective lens to acquire a first image of the sample to be measured on the fitting focal plane includes:
and 502, dividing the sample to be measured on the fitting focal plane into a plurality of visual field areas.
Specifically, because the field of view of the microscope is much smaller than the smear range for storing the sample to be tested, when the range of the blood smear is used as the fitting focal plane, the fitting focal plane needs to be divided into a plurality of field of view regions, that is, the region spliced by the plurality of field of view regions of the objective lens forms the complete fitting focal plane of the sample to be tested. The process of the objective lens for collecting the sample to be measured of the fitted focal plane is as follows: the fitting focal plane can be divided into a plurality of visual field areas, the objective lens collects the area image corresponding to each visual field area, and the area images collected by each visual field area are spliced into a first image.
And 504, controlling the objective lens to collect each visual field area on the fitting focal plane according to a preset path so as to acquire a first image.
Specifically, the preset path refers to a path of the objective lens traversing each field of view region in the fitted focal plane, and the path may be: a zigzag path, a line-by-line path, a column-by-column path, and the like, where no limitation is imposed, the objective lens traverses each field of view region according to a preset path. Dividing the fitting focal plane into a plurality of visual field areas, acquiring area images corresponding to the visual field areas of the fitting focal plane by the objective lens according to a preset path, and splicing the corresponding preset paths of the plurality of area images acquired from the visual field areas to form a first image.
It should be understood that although the various steps in the flow charts of fig. 2-5 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-5 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
In one embodiment, before controlling the objective lens to acquire the first image of the whole image acquisition area of the sample to be measured on the fitting focal plane, the method further comprises: the method comprises the steps of obtaining at least three areas to be focused of a sample to be measured in a plane to be focused, and obtaining the position and the focal length of each area to be focused, wherein the at least three areas to be focused are not on the same straight line. And determining a fitted focal plane according to the positions and focal lengths of at least three regions to be focused.
Specifically, the plane to be focused refers to a range for storing a blood smear of the sample to be measured, and the range of the blood smear is divided into a plurality of focusing areas when the range of the blood smear is used as the plane to be focused. The focusing area comprises an area to be focused and an area not to be focused, wherein the area to be focused refers to a focusing area which is selected according to needs and is used for determining the corresponding relation between the position of each focusing area in a plane to be focused and a focal length, and the area not to be focused refers to other areas which are not selected in the plane to be focused. And when at least three areas to be focused in the plane to be focused are obtained, wherein the three selected areas to be focused are not on the same straight line. And determining the moving step length of the microscope according to the position of the microscope, and determining the corresponding relation between the position of each area to be focused and the focal length according to the moving step length of the microscope. And calculating an equation corresponding to the fitted focal plane according to the position and the focal length of each region to be focused.
In one embodiment, determining a fitted focal plane according to the positions and focal lengths of at least three regions to be focused includes: and fitting a focal plane according to the positions and focal lengths of at least three regions to be focused based on a least square method.
Specifically, according to the corresponding relationship between the position of each region to be focused and the focal length, the fitted focal plane equation of the plane to be focused can be determined by using the least square method. For example, the calculation formula for fitting the focal plane equation is F (x, y) ═ a × x + b × y + c, where a, b, and c are coefficients of the focal plane equation, and can be calculated according to the position and focal length of each region to be focused.
Fig. 6 is a block diagram showing a configuration of an image capturing apparatus according to an embodiment, which is applied to a microscope system, and includes: a first acquisition module 602, a second acquisition module 604, and an acquisition module 606.
The first acquiring module 602 is configured to, when the sample to be detected is a preset sample type, control the objective lens to acquire a first image of the sample to be detected on the fitting focal plane, where the first image includes a target subject.
Specifically, the sample type of the sample to be detected is obtained by identifying a label on the sample container through a lens; and the morphological characteristic parameters of the sample to be detected can be subjected to image recognition. When the sample to be measured is a blood sample, the first collecting module 602 may enable the objective lens to collect a first image on the fitting focal plane by adjusting a height of a stage of the microscope system, where the first image includes a target body of the sample to be measured. For example, the sample to be tested is a blood smear, and the target subject of the sample to be tested is red blood cells, the objective lens collects a first image on the preset fitting focal plane, wherein the first image includes at least one red blood cell.
The second collecting module 604 is configured to control the objective lens to collect a second image of the sample to be measured on a plurality of mutually parallel preset planes, where the plurality of preset planes intersect with the fitted focal plane.
Specifically, the second collecting module 604 controls the objective lens to respectively collect one second image on each preset plane, that is, the number of the collected second images is the same as the number of the preset planes. The plurality of second images acquired may be such that there is no target subject present in one or more of the second images. Preferably, the second image without the target subject may be filtered, and at least two second images including the target subject are used for image fusion to obtain the target image.
An obtaining module 606, configured to perform image fusion on the multiple second images to obtain a target image, where the target image includes a target subject.
Specifically, the obtaining module 606 may perform fusion processing on the plurality of second images through a tone mapping algorithm or a contrast or gradient threshold based method, so as to obtain the target image. Optionally, the microscope system may further align the plurality of second images before the fusion process, so as to avoid a ghost phenomenon and improve the quality of the images. After the target image is obtained, the target main body in the target image can be identified, and the detection result of the sample to be detected is obtained from the target image. The detection result may include information such as name, kind, size, number, form, etc. of the target subject.
The image acquisition device is applied to a microscope system, the microscope system comprises an objective lens, and the device comprises a first acquisition module 602, a second acquisition module 604 and an acquisition module 606. The first acquiring module 602 is configured to, when the sample to be detected is a preset sample type, control the objective lens to acquire a first image of the sample to be detected on the fitting focal plane, where the first image includes a target subject. The second collecting module 604 is configured to control the objective lens to collect a second image of the sample to be measured on a plurality of mutually parallel preset planes, where the plurality of preset planes intersect with the fitted focal plane. An obtaining module 606, configured to perform image fusion on the multiple second images to obtain a target image, where the target image includes a target subject. According to the method, the second images are collected on the plurality of preset planes intersected with the fitting focal plane, the plurality of second images are fused to obtain the target image, the target image after the plurality of second images are fused is used as the microscopic examination image, the microscopic examination image quality can be improved, the microscopic examination efficiency is improved, and the probability of missed examination of the target main body is reduced.
The division of the modules in the image capturing device is only for illustration, and in other embodiments, the image capturing device may be divided into different modules as needed to complete all or part of the functions of the image capturing device.
For specific limitations of the image capturing device, reference may be made to the above limitations of the image capturing method, which are not described herein again. The modules in the image acquisition device can be wholly or partially realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
Fig. 7 is a schematic view of the internal structure of the microscope system in one embodiment. As shown in fig. 7, the microscope system includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor is used to provide computational and control capabilities to support the operation of the entire microscope system. The memory is used for storing data, programs and the like, and the memory stores at least one computer program which can be executed by the processor to realize the wireless network image acquisition method suitable for the microscope system provided in the embodiment of the application. The memory may include a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The computer program can be executed by a processor for implementing an image acquisition method provided in the following embodiments. The internal memory provides a cached execution environment for the operating system computer programs in the non-volatile storage medium. The network interface may be an ethernet card or a wireless network card, etc. for communicating with an external microscope system. The microscope system may be a mobile phone, a tablet computer, or a personal digital assistant or a wearable device, etc.
The implementation of each module in the image acquisition apparatus provided in the embodiments of the present application may be in the form of a computer program. The computer program may be run on a terminal or a server. The program modules constituted by the computer program may be stored on the memory of the terminal or the server. Which when executed by a processor, performs the steps of the method described in the embodiments of the present application.
Any reference to memory, storage, database, or other medium used by embodiments of the present application may include non-volatile and/or volatile memory. Suitable non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and bus dynamic RAM (RDRAM).
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. An image acquisition method applied to a microscope system including an objective lens, the method comprising:
when a sample to be detected is of a preset sample type, controlling an objective lens to collect a first image of the sample to be detected on a fitting focal plane, wherein the first image comprises a target main body;
controlling the objective lens to respectively acquire a second image of the sample to be detected on a plurality of parallel preset planes, wherein the plurality of preset planes are intersected with the fitting focal plane;
and carrying out image fusion on the plurality of second images to obtain a target image, wherein the target image comprises the target subject.
2. The method according to claim 1, wherein the fitting focal plane is an inclined plane, the Z-axis coordinates of the fitting focal plane in a field of view of the objective lens include a maximum Z-axis coordinate and a minimum Z-axis coordinate, the preset plane is a horizontal plane, the plurality of preset planes at least include a highest horizontal plane and a lowest horizontal plane, and the controlling the objective lens to acquire a second image in each of the plurality of preset planes includes:
and controlling the objective lens to respectively acquire a second image on a plurality of horizontal planes, wherein the Z-axis coordinate of the highest horizontal plane is greater than or equal to the maximum Z-axis coordinate of the fitting focal plane, and the Z-axis coordinate of the lowest horizontal plane is less than or equal to the minimum Z-axis coordinate of the fitting focal plane within a visual field range of the objective lens.
3. The method of claim 1, wherein the distance between any two adjacent preset planes is a first step, and the method further comprises:
acquiring a first number of the target subjects in the first image and acquiring a second number of the target subjects in the target image;
when the second number is lower than the first number, reducing the first step length, and resetting a plurality of preset planes according to the reduced first step length;
and controlling the objective lens to respectively collect a second image of the sample to be detected on the reset preset planes, and carrying out image fusion on the second images to update the target image.
4. The method according to claim 1, wherein the image fusing the plurality of second images to obtain a target image comprises:
acquiring the definition of the target subject in each second image;
and carrying out image fusion on at least two second images corresponding to the target subject with the definition higher than the threshold value so as to obtain the target image.
5. The method of claim 1, wherein controlling the objective lens to acquire the first image of the sample to be measured at the fitted focal plane comprises:
dividing the sample to be detected in the fitting focal plane into a plurality of visual field areas;
and controlling the objective lens to collect each field of view region on the fitting focal plane according to a preset path so as to acquire the first image.
6. The method of any one of claims 1 to 5, wherein before controlling the objective lens to acquire the first image of the entire imaging area of the sample to be measured on the fitted focal plane, the method further comprises:
acquiring at least three areas to be focused of the sample to be measured in a plane to be focused, and acquiring the position and the focal length of each area to be focused, wherein the at least three areas to be focused are not on the same straight line;
and determining the fitted focal plane according to the positions and focal lengths of at least three regions to be focused.
7. The method of claim 6, wherein determining the fitted focal plane from the positions and focal lengths of at least three of the regions to be focused comprises:
and fitting the fitted focal plane according to the positions and focal lengths of at least three regions to be focused based on a least square method.
8. An image acquisition device, for use in a microscope system, the device comprising:
the device comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for controlling an objective lens to acquire a first image of a sample to be detected on a fitting focal plane when the sample to be detected is a preset sample type, and the first image comprises a target main body;
the second acquisition module is used for controlling the objective lens to respectively acquire a second image of the sample to be detected on a plurality of parallel preset planes, and the plurality of preset planes are intersected with the fitting focal plane;
and the acquisition module is used for carrying out image fusion on the plurality of second images so as to acquire a target image, wherein the target image comprises the target main body.
9. A microscope system comprising a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, causes the processor to carry out the steps of the image acquisition method according to any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911053239.4A CN110927158B (en) | 2019-10-31 | 2019-10-31 | Image acquisition method and device, microscope system and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911053239.4A CN110927158B (en) | 2019-10-31 | 2019-10-31 | Image acquisition method and device, microscope system and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110927158A true CN110927158A (en) | 2020-03-27 |
| CN110927158B CN110927158B (en) | 2022-07-05 |
Family
ID=69850074
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911053239.4A Active CN110927158B (en) | 2019-10-31 | 2019-10-31 | Image acquisition method and device, microscope system and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110927158B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112241953A (en) * | 2020-10-22 | 2021-01-19 | 江苏美克医学技术有限公司 | Sample image fusion method and device based on multi-focus image fusion and HDR algorithm |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102982522A (en) * | 2012-12-14 | 2013-03-20 | 东华大学 | Method for realizing real-time fusion of multi-focus microscopic images |
| CN103534628A (en) * | 2011-02-01 | 2014-01-22 | 体质医学股份有限公司 | Fast auto-focus in microscopic imaging |
| CN103759837A (en) * | 2014-01-02 | 2014-04-30 | 上海大学 | Method for measuring curved surface temperature through infrared microscope |
| CN105067520A (en) * | 2015-07-28 | 2015-11-18 | 爱威科技股份有限公司 | Microscopic examination identification method and apparatus |
| CN105223110A (en) * | 2014-06-27 | 2016-01-06 | 苏州惠生电子科技有限公司 | A kind of microscope locating and tracking formation method, device and urinal system |
| CN105241811A (en) * | 2015-09-30 | 2016-01-13 | 爱威科技股份有限公司 | Multilevel focusing automatic image acquisition method and system thereof |
| CN107481213A (en) * | 2017-08-28 | 2017-12-15 | 湖南友哲科技有限公司 | Microscope hypograph multi-layer focusing fusion method |
| CN109001902A (en) * | 2018-09-05 | 2018-12-14 | 哈尔滨理工大学 | Microscope focus method based on image co-registration |
| CN110225248A (en) * | 2019-05-29 | 2019-09-10 | Oppo广东移动通信有限公司 | Image-pickup method and device, electronic equipment, computer readable storage medium |
-
2019
- 2019-10-31 CN CN201911053239.4A patent/CN110927158B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103534628A (en) * | 2011-02-01 | 2014-01-22 | 体质医学股份有限公司 | Fast auto-focus in microscopic imaging |
| CN102982522A (en) * | 2012-12-14 | 2013-03-20 | 东华大学 | Method for realizing real-time fusion of multi-focus microscopic images |
| CN103759837A (en) * | 2014-01-02 | 2014-04-30 | 上海大学 | Method for measuring curved surface temperature through infrared microscope |
| CN105223110A (en) * | 2014-06-27 | 2016-01-06 | 苏州惠生电子科技有限公司 | A kind of microscope locating and tracking formation method, device and urinal system |
| CN105067520A (en) * | 2015-07-28 | 2015-11-18 | 爱威科技股份有限公司 | Microscopic examination identification method and apparatus |
| CN105241811A (en) * | 2015-09-30 | 2016-01-13 | 爱威科技股份有限公司 | Multilevel focusing automatic image acquisition method and system thereof |
| CN107481213A (en) * | 2017-08-28 | 2017-12-15 | 湖南友哲科技有限公司 | Microscope hypograph multi-layer focusing fusion method |
| CN109001902A (en) * | 2018-09-05 | 2018-12-14 | 哈尔滨理工大学 | Microscope focus method based on image co-registration |
| CN110225248A (en) * | 2019-05-29 | 2019-09-10 | Oppo广东移动通信有限公司 | Image-pickup method and device, electronic equipment, computer readable storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112241953A (en) * | 2020-10-22 | 2021-01-19 | 江苏美克医学技术有限公司 | Sample image fusion method and device based on multi-focus image fusion and HDR algorithm |
| CN112241953B (en) * | 2020-10-22 | 2023-07-21 | 江苏美克医学技术有限公司 | Sample image fusion method and device based on multi-focus image fusion and HDR algorithm |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110927158B (en) | 2022-07-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110763679A (en) | Image acquisition method and device, microscope system and computer readable storage medium | |
| JP3822242B2 (en) | Method and apparatus for evaluating slide and sample preparation quality | |
| TWI478101B (en) | Method for assessing image focus quality | |
| US20020114497A1 (en) | Method for maintaining High-quality focus during high-throughput, microscopic digital montage imaging | |
| CN113962976B (en) | Quality evaluation method for pathological slide digital image | |
| AU2009251162B2 (en) | Method for classifying slides using scatter plot distributions | |
| CN112464802B (en) | Automatic identification method and device for slide sample information and computer equipment | |
| CN115047610B (en) | Chromosome karyotype analysis device and method for automatically fitting microscopic focusing plane | |
| CN110766650A (en) | Biological detection early warning method, system, device, computer equipment and storage medium | |
| CN110927158B (en) | Image acquisition method and device, microscope system and computer readable storage medium | |
| CN109001902A (en) | Microscope focus method based on image co-registration | |
| JP4938428B2 (en) | Specimen image creation method and apparatus | |
| US20040253616A1 (en) | Method and system of determining the stain quality of slides using a scatter plot distributions | |
| CA2229175A1 (en) | Automatic focus system | |
| CN112363309B (en) | Automatic focusing method and system for pathological image under microscope | |
| CN110793965A (en) | Image acquisition method and device, microscope system and computer readable storage medium | |
| CN115473999A (en) | Method and apparatus for imaging liquid-based cell, and storage medium | |
| CN112233060A (en) | Method and device for screening abnormal samples of digital pathological images, computer equipment and storage medium | |
| US20210223533A1 (en) | System and method for digital microscopy imaging | |
| CN116797588A (en) | Diagnostic method, device, equipment and storage medium for abnormal cells | |
| JP2021135824A (en) | Image analysis method, program, and image analysis system | |
| CN115546085A (en) | Pathological cell positioning method, device, equipment and storage medium | |
| CN117455791A (en) | Lightweight network-based rapid focusing method for scanning pathological images | |
| CN110717908A (en) | Pathological picture processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |