CN115248212A

CN115248212A - Sample image analyzing apparatus and sample analyzing system

Info

Publication number: CN115248212A
Application number: CN202110454682.3A
Authority: CN
Inventors: 姜斌; 邢圆
Original assignee: Shenzhen Mindray Bio Medical Electronics Co Ltd
Current assignee: Shenzhen Mindray Bio Medical Electronics Co Ltd
Priority date: 2021-04-26
Filing date: 2021-04-26
Publication date: 2022-10-28

Abstract

The embodiment of the invention discloses sample image analysis equipment and a sample analysis system, wherein the sample image analysis equipment comprises a bearing mechanism, a shooting assembly and a control device; the bearing mechanism is used for bearing a biological sample; the shooting assembly and the bearing mechanism can move relatively; the control device is in communication connection with the shooting assembly, and is used for controlling the shooting assembly to acquire the component images of the biological sample until the image quality of the component images meets the preset conditions, and the control device is also used for displaying the component images meeting the preset conditions on the display device.

Description

Sample image analyzing apparatus and sample analyzing system

Technical Field

The present invention relates to the field of medical images, and relates to, but is not limited to, a sample image analysis apparatus and a sample analysis system.

Background

In the related art, when a sample image (for example, a cell image) is shot, the sample needs to be moved to the vicinity of a focusing surface of an objective lens, one or more images are shot, and subsequent image enhancement processing is performed to obtain a clear sample image; however, the captured image is a blurred and unclear image due to slight up-and-down vibration of the outside or slight left-and-right shake of the sample.

Disclosure of Invention

The embodiment of the invention provides sample image analysis equipment and a sample analysis system, which can solve the problem of obtaining a fuzzy sample image in the related technology.

The embodiment of the invention provides sample image analysis equipment, which is characterized by comprising the following components:

a carrier mechanism for carrying a biological sample;

the shooting assembly and the bearing mechanism can move relatively; and

the control device is in communication connection with the shooting component and is used for controlling the shooting component to obtain the component image of the biological sample until the image quality of the component image meets a preset condition, and the control device is further used for displaying the component image meeting the preset condition on a display device.

In some embodiments, before the photographing component starts photographing, the control device is configured to control the photographing component to acquire the component image in real time for a current target area of the biological sample, and when the image quality of the component image satisfies the preset condition, the control device controls the photographing component to start photographing.

In some embodiments, in the shooting process of the shooting component, when the image quality of the component image of the current target area acquired by the shooting component does not meet the preset condition, the control device controls the shooting component to stop shooting, and when the image quality of the component image meets the preset condition, the control device controls the shooting component to continue shooting or to shoot the current target area again.

In some embodiments, after the shooting of the shooting component is completed, when the image quality of the component image of the current target area acquired by the shooting component does not meet the preset condition, the control device controls the shooting component to shoot the current target area again.

In some embodiments, when the definition of the component image is greater than or equal to a definition threshold, the image quality of the component image satisfies the preset condition.

In some embodiments, for at least two consecutive component images of the current target area, when a variation amplitude between the corresponding focuses of each component image is smaller than an amplitude threshold, the image quality of the component image satisfies the preset condition.

In some embodiments, for each component image, when a shift amount of a reference object in the component image within an exposure time of the photographing component is smaller than a first deviation threshold, an image quality of the component image satisfies the preset condition; or,

and aiming at least two continuous component images of the current target area, when the position offset amount of the same reference object in each component image is smaller than a second deviation threshold value, the image quality of the component images meets the preset condition.

In some embodiments, when the image quality of the component image does not satisfy the preset condition, the control device controls the shooting component to acquire the component image after a preset time period.

In some embodiments, after the shooting component finishes shooting the current target area of the biological sample, the shooting component and the bearing mechanism move relatively to make the next target area of the biological sample enter the visual angle range of the shooting component;

and when the control device receives that the image quality of the component image of the current target area does not meet the preset condition, the control device controls the shooting component to move relative to the bearing mechanism after shooting the next target area of the biological sample, so that the shooting component shoots the current target area again.

In some embodiments, after the shooting component shoots the current target area of the biological sample, the shooting component and the bearing mechanism move relatively to make the next target area of the biological sample enter the visual angle range of the shooting component;

the control device controls the shooting component to move relative to the bearing mechanism after shooting all target areas of the biological sample, so that the shooting component shoots the target areas of the biological sample, wherein the image quality of the target areas does not meet the preset conditions, again.

In some embodiments, after the capture component acquires the initial component image of the biological sample, the initial component image is preprocessed to obtain the component image of the biological sample.

In some embodiments, when the image quality of the component image of the current target area acquired by the photographing component does not satisfy the preset condition, the control device controls the photographing component to re-photograph the current target area in a different photographing mode.

An embodiment of the present invention further provides a sample analysis system, including:

the blood analyzer is used for carrying out routine blood detection on a biological sample;

a slide preparation device for preparing a slide coated with a biological sample; and

any one of the above sample image analyzing apparatuses for photographing a biological sample on the slide.

In the embodiment of the invention, the sample image analysis equipment comprises a bearing mechanism, a shooting assembly and a control device; the bearing mechanism is used for bearing a biological sample; the shooting assembly and the bearing mechanism can move relatively; the control device is in communication connection with the shooting assembly, the control device is used for controlling the shooting assembly to obtain the component images of the biological samples until the image quality of the component images meets the preset conditions, and the control device is further used for displaying the component images meeting the preset conditions on the display device.

Therefore, according to the embodiment of the invention, when the image quality of the obtained component image does not meet the preset condition, the shooting component is controlled to shoot the biological sample until the image quality of the component image meets the preset condition, namely, the component image with higher quality can be obtained through shooting.

Drawings

FIG. 1 is a schematic view of a slide glass in the related art;

FIG. 2A is a first schematic diagram illustrating cell dithering according to an embodiment of the present invention;

FIG. 2B is a diagram illustrating cell dithering according to an embodiment of the present invention;

FIG. 2C is a third schematic diagram of cell dithering according to an embodiment of the present invention;

FIG. 2D is a diagram illustrating cell dithering according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a sample image analysis system according to an embodiment of the present invention;

FIG. 4 is a first schematic view of a slide preparation apparatus according to an embodiment of the present invention;

FIG. 5 is a first schematic view of a slide preparation apparatus according to an embodiment of the present invention;

FIG. 6 is a first schematic structural diagram of a cellular image analysis device according to an embodiment of the present invention;

FIG. 7 is a second schematic structural diagram of a cell image analysis apparatus according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

fig. 9 is a flowchart illustrating a sample image analysis method according to an embodiment of the invention.

Detailed Description

In the related art, when a sample image (e.g., a cell image) is captured, it is necessary to move a biological sample to the vicinity of a focusing surface of an objective lens to capture one or more images.

The following exemplifies a process of capturing a component image of a biological sample in the related art for a case where the biological sample is a blood sample.

In the related art, blood cells in a blood sample can be photographed by using a device such as a blood reader; the slide reader is a device for analyzing cells on a slide, such as peripheral blood, bone marrow, and body fluid. The main working process and working principle are as follows: based on a microscopic optical and digital shooting module, an intelligent image processing algorithm is applied to automatically identify a single-layer cell area, search and shoot blood cells (white blood cells, red blood cells, platelets and the like) in the single-layer cell area, and then extract a single blood cell image. After necessary image processing is carried out on the scratched single cell image, the type and the characteristics of the cell are identified through an intelligent identification algorithm. And classifying the cells according to the characteristics of the cells, and displaying the cell images on a display. The operation user can adjust the characteristic classification result of the cells according to clinical experience, relevant information of patients and the like, and corresponding clinical conclusion is given.

In some embodiments, referring to fig. 1, in the process of taking a blood cell image using a blood reader, a blood sample smear 2 is carried on a slide 1, and then the blood sample smear 2 is moved to the vicinity of the focusing surface of an objective lens, thereby taking one or more images. In order to capture clear images of cells, it is necessary to capture the images of the cells using a microscope objective with a magnification of 100 times and a Numerical Aperture (NA) of 1.25 or 1.3 (or even higher). Because the magnification and the numerical aperture are high, the depth of field of the objective lens is only about 0.2um, so that the shooting is out of focus or blurred due to slight external vertical vibration, and finally the image displayed to a user is blurred and unclear. For example, in the actual reading process of the slide reader, slight external vibration, such as impact vibration when a slide reader platform is placed, or vibration from other sources, such as artificial accidental collision, ground shake, and the like, may cause blurring of the photographed cells, influence cell morphology recognition, and influence the slide reading result.

Referring to fig. 2A to 2D, since the magnification is large, the target cell is slightly shaken in the left and right directions, and the image is very noticeable. The imaging effect of the cells is also influenced, so that phenomena such as trailing blurring occur.

When the biological sample is urine or other biological samples, the captured component image of the biological sample is also blurred due to slight up-and-down vibration from the outside or slight left-and-right shake of the biological sample.

In view of the above technical problems in the related art, an embodiment of the present invention provides a sample image analysis device, which can be applied to a sample analysis system.

A sample analysis system for analyzing a blood sample is exemplified with reference to the accompanying drawings.

Fig. 3 is a schematic structural diagram of a sample analysis system according to an embodiment of the present invention, and as shown in fig. 3, the sample analysis system 100 may include a blood analyzer 110, a slide preparation device 120, a cell image analysis device 130, and an electronic device 140.

The blood analyzer 110 is used for performing routine blood tests on biological samples, the slide preparation device 120 is used for preparing slides coated with the biological samples, the cell image analysis device 130 is used for image shooting and analyzing cells in the slides, and the electronic device 140 is in communication connection with the blood analyzer 110, the slide preparation device 120 and the cell image analysis device 130.

The sample analysis system 100 further includes a first transport track 150 for transporting a test tube rack 10, in which a plurality of test tubes 11 loaded with a biological sample can be placed, from the hematology analyzer 110 to the slide preparation device 120, and a second transport track 160 for transporting a slide basket 20, in which a plurality of prepared slides 21 can be loaded, from the slide preparation device 120 to the cytological image analysis device 130.

The electronic device 140 is electrically connected to the first transfer rail 150 and the second transfer rail 160 and controls the operation thereof.

The sample analysis system 100 further includes

feed mechanisms

170 and 180 provided corresponding to the hematology analyzer 110 and the slide preparation device 120, respectively, each of the

feed mechanisms

170 and 180 including a

loading buffer section

171 and 181, a

feed detection section

172 and 183, and an unloading

buffer section

173 and 183.

When the biological sample on the test tube rack 10 needs to be transported to the blood analyzer 110 for testing, the test tube rack 10 is first transported from the first transport track 150 to the loading buffer 171, then transported from the loading buffer 171 to the feeding detection area 172 for testing by the blood analyzer 110, and after the testing is finished, is unloaded from the feeding detection area 172 to the unloading buffer 173, and finally enters the first transport track 150 from the unloading buffer 173.

Similarly, when the biological samples on the test tube rack 10 need to be microscopically examined, the test tube rack 10 needs to be transported to the slide preparation device 120 to prepare slides, the test tube rack 10 is first transported from the first transport track 150 to the loading buffer 181, then transported from the loading buffer 181 to the feeding detection area 182 to prepare slides by the slide preparation device 120, and after preparation of slides is completed, is unloaded from the feeding detection area 182 to the unloading buffer 183, and finally enters the first transport track 150 from the unloading buffer 183. The slide preparation apparatus 120 stores the prepared slide in the slide basket 20, and conveys the slide basket 20 storing the slide to the cell image analysis apparatus 130 through the second conveyance rail 160, and the cell image analysis apparatus 130 images and analyzes cells in the specimen on the slide.

The sample analysis system 100 further includes a display device (not shown) for displaying the result of the sample test, which may be provided on the hematology analyzer 110, the slide preparation device 120, the cell image analysis device 130, or the electronic device 140, or may be otherwise provided.

In some embodiments, the slide preparation device 120 can be used for slide preparation of biological samples such as blood, body fluids, and the like. Fig. 4 is a first schematic structural diagram of a slide preparation apparatus according to an embodiment of the present invention, and as shown in fig. 4, the slide preparation apparatus 120 includes a sampling mechanism 121 for extracting a sample, a slide loading mechanism 122 for moving a slide to a working line, a loading mechanism 123 for loading a sample onto the slide, a slide pushing mechanism 124 for leveling the sample on the slide, and a drying mechanism (not shown in the figure) for drying a blood film on the slide; in some embodiments, referring to fig. 5, the slide preparation device 120 further includes a staining mechanism 125 for staining the slides.

In some embodiments, the sampling mechanism 121 performs sample extraction by first mixing the sample, and then sucking the sample by using a sampling device (e.g., a sampling needle) in the sampling mechanism 121, wherein the sample sucking may be a puncture sample sucking (the sample container has a cover, and the sampling device passes through the cover of the sample container) or an open sample sucking (the sample container is open, and the sampling device directly sucks the sample from the open part) according to the sample container. Blood sample information detection can be performed to obtain information and comparison information, if necessary. In some embodiments, the slide preparation device 120 further includes a micro-sampling mechanism 126, and the micro-sampling mechanism 126 can move the test tube into which the operator has placed directly toward the sampling device, or alternatively, the sampling device can move the test tube into which the operator has placed. In other implementation manners, the micro sample injection mechanism 126 may also directly move the test tube to the direction of the sample injection mechanism 123, or the sample injection mechanism 123 may also move the test tube to the direction of the test tube placed by the operator, and directly load the sample after the blood sample is absorbed by the sample injection mechanism 123 (e.g., the blood dropping needle 1231), so that the requirement of the blood sample may be reduced without extracting the blood by the sampling mechanism 121, thereby realizing micro and preferential sample injection. When sampling is complete, the blood is ready to be dropped onto the slide via the sample application mechanism 123.

Accordingly, the slide loading mechanism 122 extracts the slide and loads the slide to the corresponding position to facilitate the dropping operation. In some embodiments, after the slide extraction operation is completed, slide left and right detection and slide cleaning operations may also be performed, followed by slide reloading. The loaded slide can be printed with relevant information, and the front and back detection of the slide and the like can be carried out at the same time.

The blood dropping needle of the sample adding mechanism 123 drops the sample on the slide, and then the slide pushing operation is performed, and the blood is pushed to the blood film shape on the slide by the slide pushing mechanism 124. Generally, after the slide pushing operation is completed, the blood film on the slide is dried to stabilize the shape. In some embodiments, the slide may be driven to turn over before drying the blood film to meet the corresponding requirements. In some embodiments, the dried blood smear can be further subjected to a drying test to determine the drying effect of the blood film. In some embodiments, the dried blood smear can be further subjected to blood film spreading detection to determine whether the blood film is spread and whether the spreading state meets the requirements. After the slide is pushed, the slide (blood smear) can be stained (which can be done by staining mechanism 125) or directly output (e.g., put into slide basket 20 for output)

Fig. 6 is a first structural diagram of a cell image analysis device according to an embodiment of the present invention, fig. 7 is a second structural diagram of a cell image analysis device according to an embodiment of the present invention, as shown in fig. 6 and 7, the cell image analysis device 130 at least includes an imaging device 131, a slide moving device 132, and an image analysis device 133, the imaging device 131 includes a camera 1312 and a lens assembly 1311 and is used for shooting cells in a sample smeared on a slide, the slide moving device 132 is used for moving the slide relative to the imaging device 131 so that the imaging device 131 shoots a cell image of a specific region of the slide, and the image analysis device 133 is used for analyzing the cell image of the slide.

In some embodiments, referring to fig. 7, lens group 1311 may include a first objective lens 13111 and a second objective lens 13112. The first objective lens 13111 may be a 10-fold objective lens, for example, and the second objective lens 13112 may be a 100-fold objective lens, for example. The lens assembly 1311 may further include a third objective lens 13113, and the third objective lens 13113 may be, for example, a 40-fold objective lens. Lens assembly 1311 may also include an adapter 13114 or eyepiece.

For example, the first objective lens is used to locate a target area of a biological sample, and the second objective lens or the third objective lens is used to accurately capture components of the biological sample.

In some embodiments, referring to fig. 6, the cytological image analysis apparatus 130 may further include a recognition apparatus 134, a slide gripping apparatus 135, and a slide recovery apparatus 136. The identification device 134 is used for identifying the identity information of the slide, the slide gripping device 135 is used for gripping the slide from the identification device 134 onto the slide moving device 132 for inspection, and the slide recovery device 136 is used for placing the inspected slide.

In some embodiments, referring to FIG. 6, the cytological image analysis apparatus 130 further includes a slide basket loading device 137 for loading a slide basket with slides, and the slide clamping device 135 is further configured to clamp a slide in the slide basket loaded on the slide basket loading device 137 to the identification device 134 for identification information identification. The slide basket loading device 137 is coupled to the first transfer track 160 so that slides prepared by the slide preparation device 120 can be transported to the cytological image analysis device 130.

In some embodiments, referring to fig. 8, the electronic device 140 includes at least: a processing component 141, a Random Access Memory (RAM) 142, a Read-Only Memory (ROM) 143, a communication interface 144, a Memory 146, and an Input/Output (I/O) interface 145, where the processing component 141, the RAM142, the ROM143, the communication interface 144, the Memory 146, and the I/O interface 145 communicate through a bus 147.

In some embodiments, the Processing component 141 may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microcontroller.

In some embodiments, the memory 146 contains various computer programs, such as an operating system and an application program, for execution by the processor component 141 and data necessary for execution of the computer programs. In addition, data stored locally during the biological sample testing process, if desired, may be stored in the memory 146.

In some embodiments, the I/O Interface 145 is comprised of a Serial Interface such as Universal Serial Bus (USB), institute of Electrical and Electronics Engineers (IEEE) 1394 or RS-232C, a Small Computer System Interface (SCSI), an Integrated Development Environment (IDE), or IEEE1284 parallel Interface, and an analog signal Interface comprised of a digital-to-analog (D/A) converter and an analog-to-digital (A/D) converter. The I/O interface 145 is connected to an input device including a keyboard, a mouse, a touch panel, or other control buttons, and a user can directly input data to the control apparatus 140 using the input device. Further, a display device having a display function, for example: a liquid crystal screen, a touch screen, a Light Emitting Diode (LED) display screen, etc., the electronic device 140 may output the processed data as image display data to a display for displaying, for example: analytical data, instrument operating parameters, etc.

Communication interface 144 is an interface that may be any communication protocol known today. The communication interface 144 communicates with the outside through a network. The electronic device 140 may communicate data with any of the devices connected via the network via the communication interface 144 in a communication protocol.

The sample image analysis equipment of the embodiment of the invention can comprise a bearing mechanism, a shooting assembly and a control device; the bearing mechanism is used for bearing a biological sample, and a shooting object of the shooting assembly is a component of the biological sample.

In the embodiment of the present invention, the type of the biological sample is not limited; the photographic subject may be different for different types of biological samples, as exemplified below.

In one implementation, when the type of the biological sample is peripheral blood, the bearing mechanism may include a slide, the biological sample is in the form of a blood film (blood smear), and the photographic object is red blood cells, white blood cells, platelets, and the like in the peripheral blood.

In one implementation, when the type of the biological sample is bone marrow, the subject is a cell of various maturation stages such as erythroid cell line, granulocyte cell line, lymphocyte cell line, monocyte cell line, plasma cell line, etc., and the subject may further include other cells such as megakaryocyte, reticulocyte, phagocyte, endothelial cell, fat cell, etc.

In one implementation, where the biological sample type is a urine sample, the load bearing structure may include a counting cell, the biological sample is in the form of urinary sediment, and the shooting objects are red blood cells common in urine,White colour (Bai)Cells, leukocyte aggregates, bacteria, yeast-like bacteria, epithelial cells, small round epithelial cells, crystals, hyaline casts, non-hyaline casts, mucofilaments, and the like.

In one implementation, when the biological sample type is other excreta and secretions, the object to be photographed is cellular components in a sample such as feces, vaginal secretions, semen, prostatic fluid, sputum and the like, for example, the cellular components may be common red blood cells, white blood cells, crystals, pathogenic microorganisms, epithelial cells, parasites, sperms, trichomonas, prostacholine corpuscles, prostatic granular cells, alveolar macrophages, tumor cells and the like.

In one implementation, when the type of the biological sample is coelomic fluid, the object to be captured is cerebrospinal fluid, serosal cavity effusion, articular cavity effusion, cellular components in amniotic fluid, for example, the cellular components may be common red blood cells, white blood cell clusters, bacteria, yeast-like bacteria, epithelial cells, parasites, and the like.

In one implementation, when the type of the biological sample is exfoliated cells, the subject to be imaged is epithelial cells, mesothelial cells, cancer cells, erythrocytes, leukocytes, macrophages or tissue cells, necrotic material (mucus, bacterial mass, fungal mass, plant cells, cotton wool, dye residues, etc.), parasites, and the like.

In the embodiment of the invention, the shooting assembly and the bearing mechanism can move relatively, and the control device is in communication connection with the shooting assembly; in some embodiments, the photographing component may be implemented based on the imaging device 131, and the control device may be implemented based on the electronic device 140 and the cell image analysis device 130.

In an embodiment of the present invention, the control device is configured to control the photographing component to acquire the component image of the biological sample until an image quality of the component image satisfies a preset condition, and the control device is further configured to display the component image satisfying the preset condition on the display device.

In the embodiment of the invention, the whole shooting stage of the shooting assembly can comprise a stage before starting shooting, a stage in the shooting process and a stage after finishing shooting, and before the shooting assembly starts shooting, a shooting preview image can be obtained; after the shooting component starts shooting, a stage in the shooting process can be entered, and the image acquired in the shooting process can be a shooting preview image; after the shooting is completed, an image obtained by the shooting may be acquired.

In some embodiments, before the shooting component starts shooting, the control device is used for controlling the shooting component to acquire the partial images of the current target area of the biological sample in real time, and when the image quality of the partial images meets the preset condition, the control device controls the shooting component to start shooting.

In some embodiments, one image may be taken for the components of the biological sample, or the component images may be taken multiple times for each target region (which may be a region adjacent to the focusing surface up and down or a region adjacent to the focusing surface back and forth) of the biological sample, so as to obtain one component image, where the one component image includes multiple component images.

In some embodiments, after a plurality of component images with image quality satisfying the preset condition are obtained, an image fusion technique may be used to obtain one component image with image quality satisfying the preset condition for the plurality of component images with image quality satisfying the preset condition.

In some embodiments, the component image of the biological sample obtained by the capturing component may be an initial component image obtained directly by the capturing component, or may be an image obtained by preprocessing the initial component image. Illustratively, the initial component image may be a shooting preview image directly acquired before starting shooting or during shooting without subsequent processing, or may be an image directly obtained by shooting after shooting is completed, and at least one of the following preprocessing operations is performed on the initial component image: image enhancement, depth of field fusion, high-Dynamic Range (HDR) processing.

Therefore, the embodiment of the invention can control the shooting component to acquire the initial component image or the preprocessed image (i.e. the image obtained by preprocessing the initial component image) of which the image quality of the component image meets the preset condition, thereby being beneficial to expanding the application scene of the embodiment of the invention.

As for the implementation manner of determining whether the image quality of the component image satisfies the preset condition, in a first example, if the definition of the component image of the biological sample is greater than or equal to the definition threshold, it is determined that the image quality of the component image of the biological sample satisfies the preset condition; determining that the image quality of the component image of the biological sample does not satisfy a preset condition if the sharpness of the component image of the biological sample is less than a sharpness threshold value

In the embodiment of the invention, the definition of the image can be the focusing degree used for representing the focusing precision degree, and in some embodiments, the definition threshold value can be set according to actual requirements or can be set empirically; in other embodiments, the sharpness threshold may be a statistical value dynamically determined from the historical captured images.

It is understood that if the definition of the component image of the biological sample is smaller than the definition threshold, the component image of the biological sample may be regarded as out-of-focus image or blurred image, and at this time, the control device controls the shooting component to acquire the component image of the biological sample again until the definition of the component image of the biological sample is greater than or equal to the definition threshold, that is, the embodiment of the present invention may obtain a clear component image of the biological sample.

For the implementation manner of judging whether the image quality of the component image meets the preset condition, in a second example, for at least two continuous component images of the current target area, when the variation amplitude between the corresponding focuses of the component images is smaller than the amplitude threshold, determining that the image quality of the component image of the biological sample meets the preset condition; and aiming at least two continuous component images of the current target area, when the variation amplitude between the corresponding focuses of each component image is larger than or equal to an amplitude threshold value, determining that the image quality of the component image of the biological sample does not meet a preset condition.

In some embodiments, the amplitude threshold may be set according to actual requirements, or may be set empirically; in some embodiments, the variation range between the focuses of the at least two successive component images can be obtained by comparing the degrees of sharpness of the at least two successive component images.

It can be understood that, if the variation amplitude between the focuses corresponding to the component images is greater than or equal to the amplitude threshold, the component images acquired by the shooting component may not be stable enough, and at this time, the control device may control the shooting component to acquire the component images of the biological sample again until the variation amplitude between the focuses corresponding to the component images is smaller than the amplitude threshold, that is, the embodiment of the present invention may obtain a plurality of stable and clear images.

As for the implementation manner of determining whether the image quality of the component image satisfies the preset condition, in a third example, for each component image, when the position offset amount of the reference object in the component image within the exposure time of the photographing component is smaller than the first deviation threshold, it may be determined that the image quality of the component image satisfies the preset condition; and when the position offset amount of the reference object in the component image within the exposure time of the shooting assembly is larger than or equal to the first deviation threshold value, determining that the image quality of the component image does not meet the preset condition.

Or, aiming at least two continuous component images of the current target area, when the position offset of the same reference object in each component image is smaller than a second deviation threshold value, determining that the image quality of the component images meets a preset condition; and when the position deviation amount of the same reference object in each component image is greater than or equal to a second deviation threshold value, determining that the image quality of the component image does not meet the preset condition.

In the embodiment of the present invention, the reference object may be any of the above-described photographic subjects; in some embodiments, the position offset of the reference object within the exposure time in the same image may be the length of the smear in one image.

In some embodiments, the first deviation threshold and the second deviation threshold may be set according to actual requirements, or may be set empirically.

It is understood that, if the position shift amount of the reference object in the same component image in the exposure time of the capturing component is greater than or equal to the first deviation threshold, or the position shift amount of the same reference object in each component image is greater than or equal to the second deviation threshold, which indicates that the image obtained by the capturing component is not in expectation, at this time, the control device may control the capturing component to obtain the component image of the biological sample again until the position shift amount of the reference object in the same component image in the exposure time of the capturing component image is less than the first deviation threshold, or the position shift amount of the same reference object in each component image is less than the second deviation threshold, that is, the embodiment of the present invention may obtain the component image in expectation.

In some embodiments, the control device is specifically configured to control the capturing component to re-acquire the component image of the biological sample immediately when the image quality of the component image obtained in the capturing process does not satisfy a preset condition, or control the capturing component to re-acquire the component image of the biological sample after waiting for a preset time period.

It can be seen that, in the embodiment of the present invention, when the image quality of the component image obtained in the shooting process does not meet the preset condition, the shooting component is immediately controlled to reacquire the component image of the biological sample, or the shooting component is controlled to reacquire the component image of the biological sample in a delayed manner, which is beneficial to enabling the image quality of the component image to meet the preset condition.

In some embodiments, before the photographing component starts photographing, the control device is configured to control the photographing component to acquire the partial image of the current target area of the biological sample in real time, and when the image quality of the partial image satisfies a preset condition, the control device controls the photographing component to start photographing.

In the embodiment of the invention, the component image acquired before the shooting component starts shooting is the shooting preview image, and when the image quality of the component image does not meet the preset condition, the shooting component can be controlled to repeatedly acquire the component image until the image quality of the acquired component image meets the preset condition.

Therefore, the method and the device can repeatedly execute the step of collecting the component images when the image quality of the component images collected before shooting does not meet the preset condition, so that the component images with the image quality meeting the preset condition can be obtained, and further, the method and the device are favorable for obtaining the component images with higher quality by starting the subsequent shooting process.

In some embodiments, during the shooting process of the shooting component, if the image quality of the component image of the current target area acquired by the shooting component does not meet the preset condition, the control device may control the shooting component to stop shooting, and when the image quality of the component image meets the preset condition, the control device controls the shooting component to continue shooting or to shoot the current target area again.

In the embodiment of the present invention, when the control device controls the shooting component to stop shooting, the current shooting node may be recorded, and the current shooting node may represent a shooting process node of the shooting component, for example, the current shooting node may be a node representing that the shooting component is in an auto-focus stage, a node representing that the shooting component is in automatic white balance adjustment, or another shooting process node; the control device can collect the component images of the biological samples in real time in a shooting preview mode after controlling the shooting component to stop shooting, and when the image quality of the component images of the biological samples collected in real time meets a preset condition, the current target area can be continuously shot from the current shooting node, or the current target area can be shot again.

It can be seen that, in the embodiment of the present invention, when the image quality of the component image obtained in the shooting process does not satisfy the preset condition, the component image with higher quality can be obtained by executing the process of continuing to shoot or re-shooting the current target area.

In some embodiments, after the shooting by the shooting component is completed, when the image quality of the component image of the current target area acquired by the shooting component does not meet the preset condition, the control device may control the shooting component to shoot the current target area again.

It can be seen that, in the embodiment of the present invention, if the image quality of the component image of the current target area acquired by the shooting component does not satisfy the preset condition, the control device may control the shooting component to repeatedly shoot the current target area until the component image whose image quality satisfies the preset condition is obtained.

In some embodiments, after the shooting assembly finishes shooting the current target area of the biological sample, the control device can control the shooting assembly and the bearing mechanism to move relatively, so that the next target area of the biological sample enters the visual angle range of the shooting assembly;

when the image quality of the component image of the current target area does not meet the preset condition, the control device controls the shooting assembly to move relative to the bearing mechanism after shooting the next target area of the biological sample, so that the shooting assembly shoots the current target area again.

For example, images to be shot by the shooting assembly are sequentially marked as images from a 1 st target area to a 5 th target area according to the sequence of the shooting areas, and in the shooting process from the images in the 1 st target area to the images in the 5 th target area, after the images in the 2 nd target area are shot, the control assembly can control the shooting assembly and the bearing mechanism to move relatively, so that a 3 rd target area of the biological sample enters into the visual angle range of the shooting assembly; when the image quality of the image of the 2 nd target area does not meet the preset condition, the control device can control the shooting assembly to move relative to the bearing mechanism after the shooting assembly finishes shooting the image of the 3 rd target area, so that the shooting assembly can shoot the image of the 2 nd target area again, until the image quality of the image of the 2 nd target area meets the preset condition, the control device can control the shooting assembly to move relative to the bearing mechanism, and the shooting assembly can continue to shoot the images of the 4 th target area and the 5 th target area.

In some embodiments, after the shooting assembly finishes shooting the current target area of the biological sample, the control device can control the shooting assembly to move relative to the bearing mechanism, so that the next target area of the biological sample enters the visual angle range of the shooting assembly;

and the control device controls the shooting assembly to move relative to the bearing mechanism after shooting all target areas of the biological sample, so that the shooting assembly shoots the target areas of the biological sample, the image quality of which does not meet the preset conditions, again.

For example, the images to be photographed by the photographing component are sequentially marked as images from a 1 st target area to a 5 th target area according to the sequence of the photographing areas, and in the photographing process from the image of the 1 st target area to the image of the 5 th target area, after the image of the 3 rd target area is photographed, the control component can control the photographing component and the bearing mechanism to move relatively, so that a 4 th target area of the biological sample enters the view angle range of the photographing component; when the image quality of the image of the 3 rd target area does not meet the preset condition, the control device can control the shooting assembly to move relative to the bearing mechanism after the images of the 4 th target area and the 5 th target area are shot, so that the shooting assembly can shoot the image of the 3 rd target area again until the image quality of the image of the 3 rd target area meets the preset condition.

In some embodiments, when the image quality of the component image of the current target area acquired by the photographing component does not satisfy a preset condition, the control device controls the photographing component to re-photograph the current target area in a different photographing mode.

For example, when the image quality of the component image of the current target area acquired by the photographing component does not satisfy the preset condition, the control apparatus may determine a new photographing mode different from the original photographing mode, and the control apparatus may re-photograph the current target area in the new photographing mode.

For example, the new shooting mode is: increasing the image shooting times of the current target area of the biological sample, and carrying out image fusion processing on the images shot for multiple times to obtain an image of the current target area; or, the new shooting mode is: the exposure time of the current target area of the biological sample is increased.

It should be noted that the above description is only an exemplary description of the new shooting mode, and the pre-new shooting mode may be another mode that is beneficial to improving the quality of the component image.

It can be understood that the embodiment of the invention can shoot the current target area again according to different shooting modes, thereby being beneficial to obtaining component images with higher quality.

The embodiment of the present invention further provides a sample analysis system, which may include: a blood analyzer, a slide preparation apparatus, and any one of the above sample image analysis apparatuses for taking a biological sample on the slide.

The implementation of the hematology analyzer, the slide preparation apparatus and the sample image analysis apparatus has been described in the foregoing description, and will not be described in detail here.

Based on the foregoing description, the embodiment of the present invention further provides a sample image analysis method, which is applied to the sample image analysis apparatus.

Fig. 9 is a schematic flowchart of a sample image analysis method according to an embodiment of the present invention, and as shown in fig. 9, the flowchart may include:

step 901: the control device controls the shooting component to obtain the component images of the biological sample until the image quality of the component images meets the preset conditions, and the control device is further used for displaying the component images meeting the preset conditions on the display device.

In the embodiment of the present invention, the implementation manner of controlling the shooting component to acquire the component image by the control device has been described in the foregoing description, and is not described herein again.

The foregoing description of the various embodiments is intended to highlight various differences between the embodiments, and the same or similar parts may be referred to each other, and for brevity, will not be described again herein.

The methods disclosed in the method embodiments provided by the present invention can be combined arbitrarily without conflict to obtain a new method embodiment.

Features disclosed in each product embodiment provided by the invention can be combined arbitrarily to obtain a new product embodiment without conflict.

The features disclosed in the method or device embodiments of the invention may be combined in any combination without conflict to obtain new method embodiments or device embodiments.

Through the description of the foregoing embodiments, it is clear to those skilled in the art that the method of the foregoing embodiments may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but in many cases, the former is a better implementation. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the particular illustrative embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but is intended to cover various modifications, equivalent arrangements, and equivalents thereof, which may be made by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A sample image analyzing apparatus, characterized by comprising:

a carrier mechanism for carrying a biological sample;

the shooting assembly and the bearing mechanism can move relatively; and

the control device is in communication connection with the shooting component and is used for controlling the shooting component to acquire the component image of the biological sample until the image quality of the component image meets a preset condition, and the control device is also used for displaying the component image meeting the preset condition on a display device.

2. The apparatus according to claim 1, wherein the control device is configured to control the capturing component to capture the component image of the current target area of the biological sample in real time before the capturing component starts capturing, and control the capturing component to start capturing when the image quality of the component image satisfies the preset condition.

3. The apparatus according to claim 1 or 2, wherein the control means controls the photographing component to stop photographing when the image quality of the component image of the current target area acquired by the photographing component does not satisfy the preset condition during photographing by the photographing component, and controls the photographing component to continue photographing or re-photograph the current target area when the image quality of the component image satisfies the preset condition.

4. The apparatus according to any one of claims 1 to 3, wherein the control device controls the photographing component to re-photograph the current target area when the image quality of the component image of the current target area acquired by the photographing component does not satisfy the preset condition after the photographing by the photographing component is completed.

5. The apparatus according to any one of claims 1 to 4, wherein the image quality of the component image satisfies the preset condition when a sharpness of the component image is equal to or greater than a sharpness threshold.

6. The apparatus according to any one of claims 1 to 4, wherein for at least two consecutive component images of the current target area, when a variation amplitude between the corresponding degrees of focus of each component image is smaller than an amplitude threshold, the image quality of the component image satisfies the preset condition.

7. The apparatus according to any one of claims 1 to 4, wherein, for each component image, the image quality of the component image satisfies the preset condition when a positional shift amount of a reference object in the component image within an exposure time of the photographing component is smaller than a first deviation threshold; or,

and aiming at least two continuous component images of the current target area, when the position offset of the same reference object in each component image is smaller than a second deviation threshold value, the image quality of the component images meets the preset condition.

8. The apparatus according to any one of claims 1 to 4, wherein the control device controls the capturing unit to capture the component image after a preset time period when the image quality of the component image does not satisfy the preset condition.

9. The apparatus according to claim 4, wherein after the capturing component captures the current target area of the biological sample, the capturing component and the carrying mechanism move relatively to each other to bring the next target area of the biological sample into the range of the viewing angle of the capturing component;

when the control device receives that the image quality of the component image of the current target area does not meet the preset condition, the control device controls the shooting component to move relative to the bearing mechanism after shooting the next target area of the biological sample, so that the shooting component shoots the current target area again.

10. The apparatus according to claim 4, wherein after the capturing component captures the current target area of the biological sample, the capturing component and the carrying mechanism move relatively to each other to bring the next target area of the biological sample into the range of the viewing angle of the capturing component;

11. The apparatus according to any one of claims 1 to 4, wherein after the photographing means acquires the initial component image of the biological sample, the initial component image is preprocessed to obtain the component image of the biological sample.

12. The apparatus according to claim 3 or 4, wherein the control means controls the photographing component to re-photograph the current target area in a different photographing mode when the image quality of the component image of the current target area acquired by the photographing component does not satisfy the preset condition.

13. A sample analysis system, comprising:

the specimen image analysis apparatus of any of claims 1 to 12, configured to capture a biological specimen on the slide.