CN111656247B - Cell image processing system, cell image processing method, automatic film reading device and storage medium - Google Patents

Cell image processing system, cell image processing method, automatic film reading device and storage medium Download PDF

Info

Publication number
CN111656247B
CN111656247B CN201880088257.3A CN201880088257A CN111656247B CN 111656247 B CN111656247 B CN 111656247B CN 201880088257 A CN201880088257 A CN 201880088257A CN 111656247 B CN111656247 B CN 111656247B
Authority
CN
China
Prior art keywords
different
cells
cell
images
view
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880088257.3A
Other languages
Chinese (zh)
Other versions
CN111656247A (en
Inventor
叶波
余珊
陈巧妮
邢圆
祁欢
叶燚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Mindray Bio Medical Electronics Co Ltd
Shenzhen Mindray Scientific Co Ltd
Original Assignee
Shenzhen Mindray Bio Medical Electronics Co Ltd
Shenzhen Mindray Scientific Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Mindray Bio Medical Electronics Co Ltd, Shenzhen Mindray Scientific Co Ltd filed Critical Shenzhen Mindray Bio Medical Electronics Co Ltd
Priority to CN202211549964.2A priority Critical patent/CN116088158A/en
Publication of CN111656247A publication Critical patent/CN111656247A/en
Application granted granted Critical
Publication of CN111656247B publication Critical patent/CN111656247B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10—Investigating individual particles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/0007—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration by the use of local operators
    • G06T5/30—Erosion or dilatation, e.g. thinning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro

Abstract

The invention discloses a cell image processing system, comprising: a control device configured to adjust the relative position of the digital imaging device and the smear; a digital imaging device including a lens group and a digital camera; wherein the digital camera is configured to take images of different depths of focus of cells in a field of view captured by the lens group upon vertical movement relative to the plane of the smear; and the display output device is configured to output the cell images with different focusing depths of at least one field of view to the display interface. The invention also discloses a cell image processing method, an automatic film reading device and a storage medium in the cell image processing system.

Description

Cell image processing system, cell image processing method, automatic film reading device and storage medium
Technical Field
The present invention relates to medical equipment technology, and in particular, to a cell image processing system, a cell image processing method, an automatic image reading apparatus, and a storage medium.
Background
In the related art, the depth of field when the cell is photographed is limited in the observation of the cell, and for example, when the cell is photographed through a 100-fold eyepiece of a microscope, the depth of field is only 0.3 μm. While the cells are stereoscopic, the limitation of depth of field makes it difficult to obtain a clear image of all the sections of the cells.
For example, for abnormal cells, especially immature primitive cells, medical staff often need to observe the forms and colors of cell nuclei, cytoplasm and particles of different sections of cells, and therefore, in the shooting process, the distance between the objective lens and the objective stage of the microscope needs to be manually adjusted to realize different depths of field, so as to obtain clear images of different sections of cells and comprehensively judge the types of cells.
Therefore, the identification and judgment of abnormal cells through one image of the cells are difficult, and the accurate judgment of medical staff is influenced.
Disclosure of Invention
The embodiment of the invention provides a cell image processing system, a cell image processing method, an automatic film reading device and a storage medium, which can shoot images of cells with different focusing depths in an all-around manner, so that accurate analysis of cell morphology can be performed.
The technical scheme of the embodiment of the invention is realized as follows:
an embodiment of the present invention provides a cell image processing system, including:
a control device configured to adjust a relative position of the digital imaging device and the smear;
the digital imaging device comprises a lens group and a digital camera;
wherein, the first and the second end of the pipe are connected with each other,
the digital camera is configured to capture images of different focal depths of cells in at least one of the different fields of view in the smear formed by the lens group upon vertical movement relative to the plane of the smear;
and the display output device is configured to output the cell images with different focusing depths of at least one field of view to the display interface.
The embodiment of the invention provides a cell image processing method in a cell image processing system, wherein the cell image processing method comprises the following steps:
adjusting the relative position of the digital imaging device and the smear;
in response to a parallel-direction movement of a digital camera relative to the plane of the smear, taking images of cells in respective fields of view through different fields of view in the smear formed by a lens group;
capturing images of different in-focus depths of cells in at least one of different fields of view in the smear formed by the lens group in response to vertical movement of the digital camera relative to the plane of the smear;
outputting the cell images of the different fields of view to a display interface, wherein the cell images of the different fields of view comprise: a cellular image of different in-focus depths of at least one of the different fields of view.
An embodiment of the present invention further provides a cell image processing system, where the cell image processing system includes:
a memory configured to store executable instructions;
and the processor is configured to execute the cell image processing method provided by the invention when the processor runs the executable instructions stored in the memory.
The embodiment of the invention also provides a storage medium, which stores executable instructions and is configured to cause a processor to execute the executable instructions so as to realize the cell image processing method provided by the embodiment of the invention.
The embodiment of the invention also provides an automatic film reading device, which comprises:
a receiving device configured to receive images of different focusing depths of cells in at least one of different fields of view acquired when the digital imaging device photographs the smear;
a display output device configured to output images of different in-focus depths of cells in at least one of the different fields of view to a display interface.
The embodiment of the invention also provides a film reader, which comprises:
a memory configured to store executable instructions;
a processor configured to execute, when executing the executable instructions stored by the memory, to perform:
receiving images of different focusing depths of cells in at least one of different fields of view acquired by a digital imaging device when a smear is photographed;
outputting, to a display interface, images of different in-focus depths of cells in at least one of the different fields of view.
An embodiment of the present invention further provides a storage medium, storing executable instructions, configured to cause a processor to execute the executable instructions, to implement:
receiving images of different focusing depths of cells in at least one of different fields of view acquired by a digital imaging device when a smear is photographed;
outputting to a display interface images of different in-focus depths of cells in at least one of the different fields of view.
In the embodiment of the invention, images with different focusing depths of cells in at least one of different fields of vision obtained when a digital imaging device shoots a smear are obtained; and outputting the images with different focusing depths of the cells in at least one of the different visual fields to a display interface, so that a user can accurately analyze the cell morphology through the corresponding images with different focusing depths of the cells in at least one of the different visual fields, and the misjudgment of the cell morphology caused by the deletion of the images with different focusing depths of the cells in at least one of the different visual fields is avoided.
Drawings
FIG. 1 is a schematic diagram of an alternative configuration of a cell image processing system according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of an alternative cell image processing method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of an alternative configuration of a cell image processing system according to an embodiment of the present invention;
FIG. 4A is a schematic diagram of an adjustment process in the cell image processing method according to the embodiment of the present invention;
FIG. 4B is a schematic diagram of an adjustment process in the cell image processing method according to the embodiment of the present invention;
FIG. 4C is a schematic diagram of an adjustment process in the cell image processing method according to the embodiment of the present invention;
FIG. 4D is a schematic diagram of an adjustment process in the cell image processing method according to the embodiment of the present invention;
FIG. 5A is a schematic diagram illustrating an image displaying method for cell image processing according to an embodiment of the present invention;
FIGS. 5B 1-5B 5 are schematic diagrams illustrating image display in a cell image processing method according to an embodiment of the invention;
FIGS. 5C 1-5C 4 are schematic diagrams illustrating image display in a cell image processing method according to an embodiment of the invention;
FIGS. 5D 1-5D 2 are schematic diagrams illustrating image display in a cell image processing method according to an embodiment of the invention;
FIGS. 5E 1-5E 6 are schematic diagrams illustrating image display in a cell image processing method according to an embodiment of the invention;
FIGS. 5F 1-5F 6 are schematic diagrams illustrating image display in a cell image processing method according to an embodiment of the invention;
FIG. 6 is a schematic diagram of an alternative configuration of a cell image processing system according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of an alternative structure of an automatic film reading device provided by an embodiment of the invention;
fig. 8 is an alternative structural schematic diagram of a film reader provided by the embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings. The present invention should not be construed as limited to the embodiments set forth herein, but rather the embodiments set forth herein are presented to enable those skilled in the art to make and use the invention in a full and complete manner and to convey the concept of the embodiments to others skilled in the art and, therefore, other embodiments obtained by those skilled in the art without the exercise of inventive faculty are within the scope of the invention.
Before further detailed description of the present invention, terms and expressions referred to in the embodiments of the present invention are described, and the terms and expressions referred to in the embodiments of the present invention are applicable to the following explanations.
1) Smear, i.e., a substrate to which a specimen is applied, such as a glass sheet to which blood is uniformly applied and in which blood cells are stained.
2) Digital cameras, cameras that use electronic sensors to convert optical images into electronic data.
3) A lens assembly, a device of a plurality of lens combinations, may be provided with a lens barrel for observing a magnified optical image of an object such as a cell.
4) A field of view, a range which can be observed when the magnified image of the cells in the smear is observed through the lens group;
a selected field of view, a field of view selected by a user among different fields of view in which the smear is taken, or a field of view selected by the cellular image processing system according to a preset rule.
5) The display output device is configured to display the image of the corresponding cell to the display interface, and may be, for example, a display output interface (i.e., an electrical interface) for outputting a digital/analog image signal, which is capable of outputting the image signal to an external display. The display device can also comprise a display output interface and a display device, wherein the display device is connected with the display output interface and used for receiving the signal output by the display output interface and correspondingly displaying an image.
When the display output device is implemented as a display output interface, different display devices can be connected to the display output interface according to the use environment, for example, at least two displays can be connected to realize simultaneous detection of multiple persons, and a projector can be connected to be used for teaching demonstration.
6) In response to the condition or state on which the performed operation depends, one or more of the performed operations may be in real-time or may have a set delay when the dependent condition or state is satisfied; there is no restriction on the order of execution of the operations performed unless otherwise specified.
Fig. 1 is a schematic diagram of an alternative structure of a cell image processing system according to an embodiment of the present invention, and as shown in fig. 1, an alternative structure of a cell image processing system according to an embodiment of the present invention is described below with reference to the modules in fig. 1.
A control device 101 configured to adjust the relative position of the digital imaging device and the smear based on the mechanical transmission;
the digital imaging device 102, including a lens group 1021 and a digital camera 1022;
wherein the digital camera 1022 is configured to take images of cells in different fields of view in the smear formed by the lens group 1021 when moving in a parallel direction relative to the plane of the smear;
and configured to take images of different in-focus depths of cells in at least one of different fields of view in the smear formed by the lens group 1021 upon vertical movement relative to the plane of the smear;
a display output device 103 configured to output the image of the cell in the picture to a display interface.
In the embodiment of the present invention, the digital imaging device photographs different fields of view of the smear, so as to obtain images of all cells on the smear, for example, images of all white blood cells, and display them on the display interface, but the images or smears presenting the display interface may be smaller than the area of the corresponding field of view, for example, one field of view may be 10um × 10um, and the cell image corresponding to the field of view presents only 2um × 2um, that is, a portion including target cells (such as white blood cells) in the image of the field of view is cut, so that the form of the target cells can be presented, and the limited display space can be saved.
In an embodiment of the invention, the cell image processing system includes a normal mode and a depth-of-field mode, wherein when the cell image processing system is in the normal mode, the display output device is configured to output a cell image to the display interface; preferably, the image with the highest definition in the images with different focusing depths of the cells can be output to the display interface;
when the cell image processing system is in a depth of field mode, the display output device is configured to output a plurality of cell images of different in-focus depths of cells to the display interface. By setting two different operation modes, a user can quickly adjust to the depth-of-field mode when using the cell image processing system shown in the embodiment, so as to output a plurality of cell images with different focusing depths to the display interface, thereby realizing corresponding observation activities.
In one embodiment of the invention, the control device is configured to automatically control the cell image processing system to be in a normal mode or a depth of field mode to display a corresponding number of cell images of different fields of view; alternatively, the first and second electrodes may be,
the control device is configured to control the cell image processing system to be in a normal mode or a depth of field mode according to the received user instruction so as to display corresponding number of cell images of different fields of view. The cell image processing system is controlled to enter the corresponding mode through various modes, so that a user can use the corresponding control mode according to different use environments conveniently.
In one embodiment of the present invention, the cell image processing system further includes: an automatic placing device configured to place the smear to an imaging position of the lens group 1021. By the technical scheme provided by the embodiment of the invention, automatic smear placement can be realized, and when the number of smears to be analyzed is large, the automatic smear placement is realized, so that the processing speed of the system can be increased, and the workload of medical staff is reduced.
In one embodiment of the invention, the automatic placement device is implemented as a mechanical transport, and adjusting the relative position of the digital imaging device and the smear based on mechanical transmission comprises: the smear is placed to the imaging position of the lens group 1021 by the transmission of force and the transmission of motion. For example, the mechanical transfer part may be a robot arm that clamps the smear to a position facing the lens of the lens group 1021; in some embodiments, the mechanical transport may be a belt, through which transport the smear may be transported to a position facing the lenses of the lens group 1021. Of course, the mechanical transport may use other mechanical transmission means to transport the smear.
In one embodiment of the invention, as shown in fig. 3, a containing part is arranged in the cell image processing system for containing one or more smears at one time. For example, the smear may be stored in a storage portion by being stored in a smear cassette, the storage portion may be used to store one or more smear cassettes, and each smear cassette may store one smear therein, or a plurality of smears may be stored by providing a partition.
For example, when the smear box is placed in the accommodating part, the automatic placing device conveys the smear box from the accommodating part to the area where the lens assembly 1021 is arranged in the cell image processing system, takes out the smears from the interlayer in sequence, or takes out the smears from the specified interlayer and places the smears to the imaging position of the lens assembly 1021, and returns the smears to the smear box after shooting is completed; after a smear box shoots the completion, loopback the smear box to the portion of holding to continue to shoot next smear box, realize the batchization high efficiency of smear and shoot.
In an embodiment of the present invention, in the cell image processing system to which the cell image processing method is applied, the digital imaging device includes a lens set 1021, the lens set 1021 can adopt an objective lens of a microscope, as shown in fig. 3, the cell image processing system includes a carrying part for placing one or more smears, for example, the shapes of the smears are square, circular, and the like, and a light through hole is arranged at a position where the smear is placed to ensure brightness of a captured image; a fixing portion (e.g., a jig) may be further provided for holding the smear to maintain the positional stability.
In an embodiment of the present invention, the cell image processing system includes a mechanical transmission part (the mechanical transmission part may be the same as or different from the mechanical transmission part implemented by the automatic placement device in the previous embodiment), which connects the objective lens and the object loading part, and the mechanical transmission part uses lever transmission, chain transmission, friction transmission, hydraulic transmission, gear transmission, belt transmission, etc. to transmit power to at least one of the digital imaging device and the object loading part (for placing the smear, such as the object loading platform) under the control of the control device, so as to change the relative positions of the two parts. Through the technical scheme provided by the embodiment of the invention, the change of the distance between the digital imaging device and the carrying part can be automatically realized through the mechanical transmission part.
For example, the mechanical transmission part transmits power to at least one of the digital imaging device and the object carrying part (for placing a smear, such as an object stage) to change the relative positions of the two, which can be implemented as follows: when the power is transmitted to the digital imaging device, the digital camera 1022 is moved in parallel with respect to the plane of the smear, for example, moved transversely and/or longitudinally with respect to the plane of the smear, so that the lens of the lens set 1021 can cover the whole area of the smear with cells, and different captured fields of view are photographed during the movement, thereby forming a complete image of the whole area of the smear with cells.
Through the technical scheme provided by the embodiment of the invention, the digital camera 1022 can move in parallel relative to the plane where the smear is located, and different formed visual fields are shot in the moving process, so that a complete image of the whole area of the smear with cells is obtained.
In one embodiment of the present invention, the mechanical transmission part transmits power to at least one of the digital imaging device and the object carrying part (for placing the smear, such as the object stage), so as to change the relative position of the two, which can be implemented as follows: when power is transmitted to the digital imaging device, the digital camera is moved vertically relative to the plane where the smear is located, for example, moved away from or close to the plane where the smear is located, and the moving distance is small enough (micrometer level), so that the form of the imaging field of view is not affected, different focusing depths can be formed, and images with different focusing depths can be shot by the digital camera 1022 for the same field of view. Through the technical scheme provided by the embodiment of the invention, the digital camera 1022 can move in the vertical direction relative to the plane where the smear is located, and in the moving process, images with different focusing depths are shot for the same visual field to obtain the complete image of all the areas coated with cells in the smear.
In one embodiment of the present invention, the mechanical transmission part transmits the power to at least one of the digital imaging device and the object carrying part (for placing the smear, such as the object stage), so as to change the relative position of the two, which can be implemented as follows: when the power is transmitted to the carrying part, the plane of the smear moves in parallel relative to the digital camera 1022; through the technical scheme provided by the embodiment of the invention, the transverse and/or longitudinal movement of the plane where the smear is located can be realized, the lens of the lens group 1021 can cover all areas coated with cells in the smear, and different formed visual fields are shot in the moving process, so that a complete image of all areas coated with cells in the smear is formed.
In one embodiment of the present invention, the mechanical transmission part transmits the power to at least one of the digital imaging device and the object carrying part (for placing the smear, such as the object stage), so as to change the relative position of the two, which can be implemented as follows: when the power is transmitted to the digital imaging device, the plane on which the smear is located moves vertically relative to the digital camera 1022; when power is transmitted to the digital imaging device, in the process that the plane where the smear is located moves in the vertical direction relative to the digital camera 1022, the cell image processing system can also detect the placement position of the smear before the movement in the vertical direction is completed, and when the movement of the smear in the parallel direction exceeds a movement threshold value, the position of the smear can be adjusted to realize a form that does not influence the imaging field of vision. Through the technical scheme provided by the embodiment of the invention, the smear can be moved away from or close to the plane in the vertical direction, the moving distance is small enough (micrometer level), so that the form of the imaging field of view is not influenced, different focusing depths can be formed by adjusting, and the digital camera 1022 shoots the different formed fields of view to form a complete image of the whole area coated with cells in the smear.
In one embodiment of the invention, the lens group of the cell image processing system is implemented as a lens barrel provided with a plurality of convex lenses, and when the lenses of the lens group face the smear, a magnified image of the cells in the smear portion area is formed in the field of view of the lens group. Through the technical scheme provided by the embodiment of the invention, the formation of an enlarged image of one cell or a plurality of cells in a visual field can be realized. For example, the lenses in the lens group 1021 are plastic lenses (plastic lenses) and glass lenses (glass lenses), and different lens combinations form different magnifications, such as 10 times, 40 times, 100 times, and the like.
In one embodiment of the present invention, the lens set 1021 of the cell image processing system is multiple, and can be arranged on a turntable, and the lens set 1021 facing the smear is switched by the rotation of the turntable, so as to form the vision field with different magnifications of the smear. According to the technical scheme provided by the embodiment of the invention, as the number of the lens combinations of the cell image processing system is multiple, the lens combinations adaptive to different target cells can be timely switched according to different target cells, so that the clearest image aiming at the target cells can be obtained.
In an embodiment of the present invention, when the number of the lens groups of the cell image processing system is multiple, a plurality of digital camera lenses may be provided, the digital camera lenses and the plurality of lens groups of the camera are in one-to-one correspondence, and when the lens groups are adjusted, the corresponding digital camera lenses are adjusted.
In one embodiment of the invention, the display output device 103 is configured to output the images of the cells in the plurality of fields of view of the smear to a display interface at a time; through the technical scheme provided by the embodiment of the invention, medical staff can conveniently observe the images of the cells in a plurality of visual fields of the smear at one time on one display interface, and the statistics of the proportion of the pathological cells is more convenient.
In one embodiment of the invention, the display output device 103 is configured to output the image of the cells in any one field of the smear at a time on the display interface; through the technical scheme provided by the embodiment of the invention, the medical staff can acquire the images with different focusing depths of the required specific target cells in the observation process of some pathological cells so as to determine the characteristic information of the pathological cells and the peripheral cells.
In an embodiment of the invention, the display output device 103 is further configured to output an image including one cell or output an image including a plurality of cells when displaying the image of the cells in the field of view of the smear. By the technical scheme provided by the embodiment of the invention, the processing and display of the image of one cell needing to be output can be realized, and further, the focusing and shooting of the images of a plurality of cells can be realized quickly when the images of a plurality of cells need to be output.
In an embodiment of the present invention, the display output device 103 is further configured to output the image with the highest resolution corresponding to the selected area when the partial area of one image of the cell images with different focusing depths of the at least one field of view is selected, and the image with the highest resolution corresponding to the selected area of the image may also be another image of the image or the cell images with different focusing depths of the field of view. Through the technical scheme provided by the embodiment of the invention, in the observation process of some special target cells, the cells which need to meet certain focusing definition can be quickly focused and shot for imaging.
In one embodiment of the present invention, the display output device 103 is further configured to switch to output images of different focusing depths of cells in a selected field of view when the selected field of view exists in different fields of view of the smear; the selected field of view is a field of view selected by a user among different fields of view in which the smear is taken or a field of view selected by the cellular image processing system according to a preset rule. The user can select the image of a certain view field through the mouse, and after the image of the view field with different focusing depths is selected, the image of the view field with different focusing depths can be output. When the system selects according to a preset rule, if the system identifies that abnormal cells exist in an image of a certain visual field, the visual field is automatically selected, and images with different focusing depths of the visual field are output; or the system identifies that the cell in the image of a certain field of view is a large cell, automatically selects the field of view, and outputs images of different focusing depths of the field of view, wherein the large cell is a cell with the diameter or the projection area of the cell larger than a preset threshold value. Through the technical scheme provided by the embodiment of the invention, the medical staff can acquire the images with different focusing depths of the required specific target cells in the observation process of some pathological cells so as to determine the characteristic information of the pathological cells and the peripheral cells.
In an embodiment of the invention, the display output device 103 is further configured to switch and output images of different focusing depths of cells in a selected field of view according to human-computer interaction when the selected field of view exists in different fields of view of the smear, wherein the selected field of view is a field of view selected by a user in different fields of view of the smear taken or a field of view selected by the cell image processing system according to preset rules. By the technical scheme provided by the embodiment of the invention, circular switching output can be realized, and further, different focusing depth images can be controlled to be switched and output through man-machine interaction. Thus, medical personnel no longer need to manually select the field of view and manually adjust the cell imaging system.
In an embodiment of the present invention, the display output device 103 is further configured to automatically switch to output images of different focusing depths of cells in a selected field of view when the selected field of view exists in different fields of view of the smear. By the technical scheme provided by the embodiment of the invention, automatic switching of images displaying different focusing depths of cells in a selected visual field can be realized, the complicated operation of manual switching is avoided, and the operation speed is improved.
In one embodiment of the present invention, when the display output device 103 outputs an image including a plurality of cells, a set type of cell (e.g., a white blood cell or a diseased cell) may be centered in the image for observation. Through the technical scheme provided by the embodiment of the invention, the cell of the set type can appear in the center of the image, so that medical personnel can accurately identify the cell of the set type.
In an embodiment of the present invention, the outputting, by the display output device 103, an image of the cells in the corresponding field of view or an image of the cells in at least one of the different fields of view with different focusing depths according to the image of the cells in the corresponding field of view captured by the digital camera 1022 or the image of the cells in at least one of the different fields of view, to a display interface, includes: when the display output device 103 outputs the image of the cells in the visual field of the smear, the image with focusing satisfying the preset condition is output, wherein the output image can be the image with focusing definition satisfying the definition condition. The outputting the image with focusing satisfying the preset condition comprises: and automatically presenting the image of the cell which meets the preset focusing definition and is most clear in the selected area in the display area in the selected state. Through the technical scheme provided by the embodiment of the invention, in the observation process of some special target cells, the cells which need to meet certain focusing definition can be quickly focused and shot for imaging.
In one embodiment of the present invention, the control device 101 may search for an image display with a resolution higher than a resolution threshold from the images with different focusing depths captured by the digital camera 1022, wherein the resolution threshold may be set by the system and/or the user according to different types of cells. Through the technical scheme provided by the embodiment of the invention, images with different definitions aiming at set type cells can be independently controlled and selected.
In an embodiment of the present invention, the control device 101 may search for an image with the highest definition from among images with different focusing depths captured by the digital camera 1022 and output the image by the display output device 103. By the technical scheme provided by the embodiment of the invention, the image with the highest definition can be automatically acquired no matter what set type of cells.
In one embodiment of the present invention, the display output device 103 is further configured to output images of different focusing depths formed by the selected field of view taken via the digital camera 1022 when the selected field of view exists in the different fields of view of the smear.
In one embodiment of the invention, the display output device 103 is further configured to display an image forming a new depth of focus for the taking when the selected one of the different fields of view of the smear is present.
In one embodiment of the invention, the display output device 103 is further configured to output a registered image of the different in-focus depth images of the selected field of view when the selected field of view is present in the different fields of view of the smear.
In one embodiment of the present invention, the new image with the focusing depth is formed by performing the interpolation processing of the focusing depth on the image formed by the capturing of the digital camera 1022, for example, the distribution of the focusing depth of the image formed by the capturing of the digital camera 1022 is: d1, D3 and D5 (sequentially increasing), the focusing depths formed by the difference values are D2 and D4, and the new focusing depths are distributed as D1, D2, D3, D4 and D5 (sequentially increasing); the problem of discontinuity caused by too small number of original images is solved, meanwhile, the shooting time of a single smear is shortened by using background interpolation of software, and the smear processing efficiency of the cell image processing system is improved. By the technical scheme provided by the embodiment of the invention, when images with different focusing depths are required, only the image with the largest focusing depth and the image with the lowest focusing depth can be shot, and the evolution process of the images with different focusing depths is obtained in an interpolation processing mode, so that the defect that the original focusing depth is not clear is made up, and the shooting time of a single smear is shortened.
In an embodiment of the present invention, the controlling device 101 outputs the image with different focusing depths of the cells in at least one of the different fields of view to a display interface according to the image of the cells in the corresponding field of view or the image with different focusing depths of the cells in at least one of the different fields of view captured by the digital camera 1022, including: when the display output device 103 outputs the image of the cells in the field of view of the smear, an image focused to satisfy a preset condition is output, wherein the output may be an image focused to satisfy a definition condition. The outputting the image with focusing satisfying the preset condition comprises: and automatically presenting the image of the cell which meets the preset focusing definition and is most clear in the selected area in the display area in the selected state. Through the technical scheme provided by the embodiment of the invention, in the observation process of some special target cells, the cells which need to meet certain focusing definition can be quickly focused and shot for image presentation.
In one embodiment of the present invention, the control device 101 may search for an image display with a resolution higher than a resolution threshold in the images with different focusing depths captured by the digital camera 1022, wherein the resolution threshold may be set by the system and/or the user according to different types of cells. Through the technical scheme provided by the embodiment of the invention, images with different definitions aiming at set type cells can be independently controlled and selected.
In an embodiment of the present invention, the image with the highest definition may be searched and displayed in the images with different focusing depths captured by the digital camera 1022. By the technical scheme provided by the embodiment of the invention, the image with the highest definition can be automatically acquired no matter what set type of cells.
In one embodiment of the invention, the display output device 103 of the cell image processing system is configured to simultaneously present a plurality of images of different in-focus depths of the cells in at least one of the different fields of view.
For example, when the images with different focusing depths correspond to different image numbers, the display output device 103 may display the images with the number of 1 in sequence, or may select to display several images, such as the images with the numbers of 3-7, so that the user can observe the cells in all directions by simultaneously displaying a plurality of images with different focusing depths of the cells in at least one of the different fields, thereby obtaining a more accurate determination result.
In one embodiment of the present invention, the display output device 103 can also dynamically display a plurality of images with different focusing depths of cells in at least one of the different fields of view, so that the user can flexibly observe different images with the required focusing depths.
In one embodiment of the present invention, the digital camera 1022 can also take different number of images of cells for different diameters, for example, 10 images for cells with a cell diameter exceeding 10 microns, 5 images for cells with a cell diameter not exceeding 10 microns, and display all the images taken according to the cell diameter.
In an embodiment of the present invention, the display output device 103 is further configured to: when the cells in at least one of the different visual fields are judged to be normal cells, outputting at least one image of the normal cells, which accords with preset definition, to the display interface; preferably, when the cell in at least one of the different fields of view is judged to be a normal cell, an image with the highest resolution photographed for the normal cell is output to the display interface. When the cell in at least one of the different visual fields is judged to be an abnormal cell, outputting images of the abnormal cell with different focusing depths to the display interface. In the operation process of the display output Device 103, the control Device 101 may be further configured to determine whether the cell is normal, and at this time, the process of identifying the cell by the control Device 101 may be performed by a Controller included in the control Device 101, where the Controller may be implemented in the form of one or more Application Specific Integrated Circuits (ASICs), DSPs, programmable Logic Devices (PLDs), complex Programmable Logic Devices (CPLDs), field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro Controllers (MCUs), microprocessors (microprocessors), or other electronic components, and is configured to perform the function of determining whether the cell is normal. Wherein the digital camera 1022 captures the same number of cell images regardless of whether the cell is determined to be a normal cell or an abnormal cell.
In an embodiment of the invention, the control device 103 is configured to obtain the sharpness of the images captured by the digital camera and to select at least one image with sharpness exceeding a preset threshold when capturing images of different in-focus depths of cells in at least one of the different fields of view. During the operation of the display output device, the control device 101 can be further configured to acquire the sharpness of the images captured by the digital camera, and select at least one image whose sharpness exceeds a preset threshold when capturing images of different in-focus depths of cells in at least one of the different fields of view. According to the technical scheme provided by the embodiment of the invention, at least one image with the definition exceeding the preset threshold can be quickly selected by judging the definition of the shot image, so that the speed of judging the corresponding cell by the image with the corresponding resolution of a user is increased. At this time, the process of determining the definition of the image and selecting the corresponding image by the control Device 101 may be performed by a Controller included in the control Device, wherein the Controller may be implemented by one or more Application Specific Integrated Circuits (ASICs), DSPs, programmable Logic Devices (PLDs), complex Programmable Logic Devices (CPLDs), field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro Controllers (MCUs), microprocessors (microprocessors), or other electronic components, and is configured to perform the functions of determining the definition of the image and selecting the corresponding image.
In an embodiment of the present invention, the control device 101 is further configured to identify whether there is an abnormality in the cells in the corresponding field of view, and the digital camera 1022 is further configured to capture at least one image with a preset resolution for the cells in the field of view in which there is no abnormal cell and output the captured image to the interface of the display output device 103 for display, and preferably, when the cells in at least one of the different fields of view are determined to be normal cells, output the image with the highest resolution captured for the normal cells to the interface of the display output device 103 for display. For example, the digital camera 1022 is further configured to capture an image corresponding to the maximum sharpness of the cells in the visual field without abnormal cells and output the image to the interface of the display output device 103 for display.
In an embodiment of the invention, the control device 101 is configured to set a range of focus depths. By the technical scheme provided by the embodiment of the invention, the range of the focusing depth of the cell image processing system can be correspondingly and flexibly adjusted according to the characteristics of the cells to be detected. In the operation process of the display output Device, the control Device 101 may be further configured to set a range of focusing depths, and in this case, the process of setting the range of focusing depths by the control Device 101 may be performed by a Controller included in the control Device 101, wherein the Controller may be represented by one or more Application Specific Integrated Circuits (ASICs), DSPs, programmable Logic Devices (PLDs), complex Programmable Logic Devices (CPLDs), field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro Controller Units (MCUs), microprocessors (processors), or other electronic elements configured to perform the function of setting the range of focusing depths.
In an embodiment of the present invention, the control device 101 may be further configured to set a difference between the focal depths of the images with different focal depths of at least one of the different fields of view, and the difference between the focal depths of each two adjacent images among the images with different focal depths may be the same or different. According to the technical scheme provided by the embodiment of the invention, as the difference of the focusing depths of the images with different focusing depths of at least one view field in different view fields is set, at least one view field in different view fields has the corresponding focusing depth, and the adjusting time of manual operation in the using process is saved. During operation of the display output Device, the control Device 101 may be further configured to set a range of focus depths, and at this time, the control Device 101 may perform a process of setting a difference between focus depths of images of different focus depths of at least one of the different fields of view by a Controller included in the control Device, wherein the Controller may be represented by one or more Application Specific Integrated Circuits (ASICs), DSPs, programmable Logic Devices (PLDs), complex Programmable Logic Devices (CPLDs), field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro Controllers (MCUs), microprocessors (microprocessors), or other electronic components, and is configured to perform a function of setting a difference between focus depths of images of different focus depths of at least one of the different fields of view.
In one embodiment of the present invention, the display output device 103 is configured to: when the diameter or the projection area presented by the cell is judged to exceed a first preset threshold value, outputting images of the cell with different focusing depths; and when the diameter or the projection area of the cell is judged to be smaller than a second preset threshold value, outputting an image with the highest definition shot for the cell. The first preset threshold and the second preset threshold may be equal to each other, or the first preset threshold is greater than the second preset threshold.
In an embodiment of the present invention, when the presented area of the cell exceeds a first preset threshold, the display output device 103 is configured to output images of different focusing depths of the cell; when the diameter or the projection area of the cell is smaller than a second preset threshold, the display output device 103 is configured to output the image with the highest definition photographed for the cell; the first preset threshold is greater than or equal to the second preset threshold. For example, the first preset threshold is 20 micrometers, and the second preset threshold is 10-15 micrometers, by using the technical scheme provided by the embodiment of the invention, different display modes can be adopted for different cells to be detected, and when the cells to be detected are primitive cells (naive primitive cells), the images with different focusing depths can be output in time so as to facilitate detection by a user.
In some embodiments of the present invention, the display output device 103 includes a display output interface configured to output a signal corresponding to the image to an external device.
In some embodiments, the display output apparatus 103 further includes a display device connected to the display output interface, and configured to receive the signal output by the display output interface and display an image correspondingly.
In an embodiment of the present invention, the application environment is that multiple persons detect the same cell at the same time, in which case, the display output device 103 may be connected to at least two display output devices or connected to a projector, and different users detect and observe the same cell. When the display output device is connected with at least two display output devices, different users can simultaneously watch the cell images which are shot and stored by the cell image processing system and have different focusing depths; when the display output device is connected with at least two display output devices, the operation users of different display output devices can have different operation thresholds, wherein the user with the highest operation threshold can watch the cell images which are shot and stored by the cell image processing system and have different focusing depths, and the display output devices of the users corresponding to other operation thresholds are controlled to synchronously display. According to the technical scheme provided by the embodiment of the invention, in clinical application, in the case of complex detection samples and possible consultation of multiple doctors together, multiple doctors can respectively judge the samples, and meanwhile, through the technical scheme provided by the embodiment of the invention, a supervisor doctor can also utilize the cell image processing system to carry out cell observation training on interns.
In an embodiment of the present invention, the cell image processing system may be suitable for indoor use and may also be suitable for vehicle-mounted use, and a use environment of the cell image processing system needs to be adapted to the cell image processing system to meet a use condition of the cell image processing system.
Fig. 2 is a schematic flow chart of an alternative cell image processing method according to an embodiment of the present invention, where the cell image processing method according to the embodiment of the present invention is applied to a cell image processing system, and the cell image processing system includes: the digital imaging device comprises a lens group and a digital camera. Referring to fig. 2, an alternative flowchart of a cell image processing method according to an embodiment of the present invention is provided to describe the illustrated steps.
Step 201: the relative position of the digital imaging device and the smear is adjusted based on mechanical transmission.
In one embodiment of the invention, before adjusting the relative position of the digital imaging device and smear based on mechanical transmission, the method further comprises: and placing the smear to the imaging position of the lens group by an automatic placing device. By the technical scheme provided by the embodiment of the invention, automatic smear placement can be realized, and when the number of smears to be analyzed is large, the automatic smear placement is realized, so that the processing speed of the system can be increased, and the workload of medical staff is reduced.
In one embodiment of the invention, the automatic placement device comprises a mechanical transport, and adjusting the relative position of the digital imaging device and the smear based on mechanical transmission comprises: the smear is placed to the imaging position of the lens group through the transmission of force and the transmission of motion. Through the technical scheme provided by the embodiment of the invention, the cell image processing process can be implemented as a mechanical arm through the mechanical transmission part, and the smear is clamped to the position facing to the lens of the lens group; the smear can also be transported to the position facing the lens of the lens group by a mechanical transport embodied as a belt.
For example, after the smear box is placed in the accommodating part, the automatic transmission device conveys the smear box from the accommodating part to an area where a lens group is arranged in the cell image processing system, takes out the smears from the interlayer in sequence, or takes out the smears from a specified interlayer and places the smears to the imaging position of the lens group, and returns the smears to the smear box after shooting is completed; when the shooting of one smear box is finished, the smear box is returned to the accommodating part, and the next smear box is continuously shot, so that the batched and high-efficiency shooting of smears is realized.
In an embodiment of the present invention, in the cell image processing system to which the cell image processing method according to the embodiment of the present invention is applied, the digital imaging device includes a lens group that can adopt an objective lens of a microscope, as shown in fig. 3, the cell image processing system includes a carrying part for placing one or more smears, for example, the shape of the carrying part is square, circular, etc., and a light through hole is arranged at the position where the smear is placed to ensure the brightness of the captured image; a fixing portion (e.g., a jig) may be further provided for holding the smear to maintain the positional stability.
In one embodiment of the invention, the control device in the cell image processing system comprises a mechanical transmission part which connects the objective lens and the carrying part, and the mechanical transmission part transmits power to at least one of the digital imaging device and the carrying part (for placing the smear, such as a carrying platform) by using a lever transmission mode, a chain transmission mode, a friction transmission mode, a hydraulic transmission mode, a gear transmission mode, a belt transmission mode and the like, so that the relative position of the digital imaging device and the carrying part is changed. Through the technical scheme provided by the embodiment of the invention, the change of the distance between the digital imaging device and the carrying part can be automatically realized through the mechanical transmission part.
In one embodiment of the present invention, the transmitting power to at least one of the digital imaging device and the object loading part (for placing the smear, such as the object loading table) so as to change the relative position of the two comprises: when the power is transmitted to the digital imaging device, the digital camera moves parallelly relative to the plane where the smear is located, for example, moves transversely and/or longitudinally relative to the plane where the smear is located, so that the lens of the lens group can cover all areas coated with cells in the smear, and different formed visual fields are shot in the moving process, thereby forming a complete image of all areas coated with cells in the smear. Through the technical scheme provided by the embodiment of the invention, the digital camera can move in parallel relative to the plane where the smear is located, and different formed visual fields are shot in the moving process so as to obtain a complete image of the whole area coated with cells in the smear.
In one embodiment of the present invention, the transmitting power to at least one of the digital imaging device and the object loading part (for placing the smear, such as the object loading table) so as to change the relative position of the two comprises: when power is transmitted to the digital imaging device, the digital camera moves in the vertical direction relative to the plane where the smear is located, for example, moves away from or approaches to the plane where the smear is located, the moving distance is small enough (micrometer level), so that the form of the imaging field of view is not affected, different focusing depths can be formed, and the digital camera shoots the formed different fields of view to form a complete image of the whole area where the cells are smeared in the smear. Through the technical scheme provided by the embodiment of the invention, the digital camera can move in the vertical direction relative to the plane where the smear is located, different formed visual fields are shot in the moving process to obtain the complete image of all the areas coated with the cells in the smear, and the focal depth is changed by adjusting in the vertical direction, so that the obtained complete image of all the areas coated with the cells in the smear can be the complete image of all the areas of the cells corresponding to different focal depths.
In one embodiment of the present invention, the transmitting power to at least one of the digital imaging device and the object loading part (for placing the smear, such as the object loading table) so as to change the relative position of the two comprises: when the power is transmitted to the object carrying part, the plane of the smear moves in parallel relative to the digital camera; by the technical scheme provided by the embodiment of the invention, the transverse and/or longitudinal movement of the plane where the smear is located can be realized, so that the lens of the lens group can cover all areas coated with cells in the smear, and different formed visual fields are shot in the moving process, thereby forming a complete image of all the areas coated with cells in the smear.
In one embodiment of the present invention, the transmitting power to at least one of the digital imaging device and the object loading part (for placing the smear, such as the object loading table) so as to change the relative position of the two comprises: when the power is transmitted to the digital imaging device, the plane where the smear is located moves vertically relative to the digital camera; through the technical scheme provided by the embodiment of the invention, the smear can be moved away from or close to the plane in the vertical direction, the moving distance is small enough (micrometer level), so that the form of the imaging field of view is not influenced, different focusing depths can be formed by adjusting, and the digital camera shoots the different formed fields of view to form a complete image of all areas coated with cells in the smear. Further, in this embodiment, when power is transmitted to the digital imaging device, in the process that the plane where the smear is located moves in the vertical direction relative to the digital camera, the cell image processing system may further detect the placement position of the smear before the movement in the vertical direction is completed, and when it is found that the movement of the smear in the parallel direction exceeds the movement threshold, the position of the smear may be adjusted to realize a form that does not affect the field of view of imaging.
In one embodiment of the invention, the lens group of the cell image processing system is implemented as a lens barrel provided with a plurality of convex lenses, centers of the convex lenses are in the same line in the lens barrel, and when the lenses of the lens group face the smear, a magnified image of the cells of the smear part area is formed in the visual field of the lens group. Through the technical scheme provided by the embodiment of the invention, the formation of an enlarged image of one cell or a plurality of cells in a visual field can be realized. Further, the lenses in the lens group are of plastic lens (plastic lens) and glass lens (glass lens) types, and different lens groups are combined to form different magnifications, such as 10 times, 40 times, 100 times, and the like.
In one embodiment of the invention, the cell image processing system has a plurality of lens groups, the lens groups can be arranged on a turntable, and the lens groups facing the smear are switched by the rotation of the turntable to form the vision fields with different magnifications of the smear. According to the technical scheme provided by the embodiment of the invention, as the number of the lens groups of the cell image processing system is multiple, the lens groups adapted to the target cells can be timely switched aiming at different target cells, so that the clearest image aiming at the target cells can be obtained.
In an embodiment of the present invention, when the number of the lens groups of the cell image processing system is multiple, a plurality of digital camera lenses may be provided, the digital camera lenses and the plurality of lens groups of the camera are in one-to-one correspondence, and when the lens groups are adjusted, the corresponding digital camera lenses are adjusted.
Step 202: and judging whether the digital camera is controlled to move in a parallel direction relative to the plane of the smear or not, if so, executing step 203, and otherwise, executing step 204.
Step 203: in response to the parallel-direction movement of the digital camera relative to the smear plane, taking images of the cells in the respective fields of view through the different fields of view in the smear formed by the lens group.
Step 204: judging whether the digital camera is controlled to move vertically relative to the plane of the smear, if so, executing step 205, otherwise, executing step 206;
step 205: taking images of different in-focus depths of cells in at least one of the different fields of view in the smear formed by the lens group in response to vertical movement of the digital camera relative to the plane of the smear.
Step 206: sending out prompt information;
the prompt information is used for representing that the collection of the cell image processing system is wrong.
Step 207: outputting, to a display interface, an image of different in-focus depths of cells in at least one of the different fields of view based on the captured image of cells in the respective field of view or the image of different in-focus depths of cells in at least one of the different fields of view.
In one embodiment of the invention, the method further comprises: the display output device may sequentially display the images with different focusing depths of the cells in at least one of the different fields of view, for example, when the images with different focusing depths correspond to different image numbers, or may selectively display a plurality of images, for example, images with display numbers 3 to 7, from the image with the number 1, so that the user can observe the cells in all directions by simultaneously displaying the images with different focusing depths of the cells in at least one of the different fields of view, thereby obtaining a more accurate judgment result.
In one embodiment of the invention, the method further comprises: and dynamically displaying a plurality of images with different focusing depths of cells in at least one of the different fields of view, so that a user can flexibly observe different images with required focusing depths. For example, the cell image processing system can also take different numbers of cell images for cells of different diameters, for example, 10 images for cells whose cell diameters exceed 10 micrometers, 5 images for cells whose cell diameters do not exceed 10 micrometers, and display all the images taken according to the cell diameters.
In an embodiment of the present invention, the outputting to the display interface the images of different in-focus depths of the cells in at least one of the different fields of view further comprises: when the shot cells are recognized to be normal cells, outputting images with highest definition shot on the normal cells to the display interface; when the shot cells are identified to be abnormal cells, outputting images of the abnormal cells with different focusing depths to the display interface; and when the cells in at least one of the different visual fields are judged to be abnormal cells, outputting images of different focusing depths of the abnormal cells to the display interface. The determination of whether the cell is normal or not can be performed by a cell recognition device included in the image processing system, and the cell recognition device can be a hardware device with a cell recognition function, or a corresponding program run in a logic processing unit of the image processing system. Wherein the digital camera takes the same number of cell images regardless of whether the cell is judged to be a normal cell or an abnormal cell.
In one embodiment of the invention, the method further comprises: judging the definition of the image shot by the digital camera; selecting at least one image with a sharpness exceeding a preset threshold when taking images of different in-focus depths of cells in at least one of the different fields of view.
In one embodiment of the invention, the method further comprises: setting a range of focus depths or setting a difference between focus depths of images of different focus depths of at least one of the different fields of view. Therefore, the range of the focusing depth of the cell image processing system can be correspondingly and flexibly adjusted according to the characteristics of the cells to be detected. In the working process of outputting the cell image, the setting of the range of the focusing depth may be completed by a setting device included in the image processing system, and the setting device may be a hardware device with a parameter setting function, or may be a corresponding program run in a logic processing unit of the image processing system to implement the setting of the range of the focusing depth.
In one embodiment of the invention, the method further comprises: recognizing the morphology of the cell; when the diameter or the projection area presented by the cell is judged to exceed a first preset threshold value, outputting images of the cell with different focusing depths; and when the diameter or the projection area of the cell is judged to be smaller than a second preset threshold value, outputting an image with the highest definition for shooting the cell. The first preset threshold may be greater than or equal to the second preset threshold. In the process of outputting the cell image, the determination of the cell morphology may be performed by a cell morphology recognition device included in the image processing system, and the cell morphology recognition device may be a hardware device with a cell morphology recognition function, or may be a corresponding program run in a logic processing unit of the image processing system. When the area presented by the cell exceeds a first preset threshold, the display output device is configured to output images of different focusing depths of the cell; when the projection area of the cell is smaller than a second preset threshold value, the display output device is configured to output the image with the highest definition, which is shot on the cell; the first preset threshold is greater than the second preset threshold. For example, the first preset threshold is 20 micrometers, and the second preset threshold is 10-15 micrometers, by using the technical scheme provided by the embodiment of the invention, different display modes can be adopted for different cells to be detected, and when the cells to be detected are primitive cells (naive primitive cells), the images with different focusing depths can be output in time so as to facilitate detection by a user.
In an embodiment of the invention, the outputting, to a display interface, the image of the different in-focus depths of the cells in at least one of the different fields of view according to the captured image of the cells in the corresponding field of view or the image of the different in-focus depths of the cells in at least one of the different fields of view includes: and outputting the images of the cells in the plurality of visual fields of the smear to a display interface at one time. Through the technical scheme provided by the embodiment of the invention, medical staff can conveniently observe the images of the cells in a plurality of visual fields of the smear at one time on one display interface, and the statistics of the proportion of diseased cells is more convenient.
In an embodiment of the present invention, the outputting, to a display interface, an image of different in-focus depths of cells in at least one of the different fields of view according to the captured image of cells in the corresponding field of view or the image of different in-focus depths of cells in at least one of the different fields of view includes: and outputting the image of the cells in any visual field of the smear at one time on the display interface. Through the technical scheme provided by the embodiment of the invention, the images with different focusing depths of the required specific target cells can be acquired in the observation process of the medical staff on certain pathological cells, so as to determine the characteristic information of the pathological cells and the peripheral cells.
In an embodiment of the present invention, the outputting, to a display interface, an image of different in-focus depths of cells in at least one of the different fields of view according to the captured image of cells in the corresponding field of view or the image of different in-focus depths of cells in at least one of the different fields of view includes: when displaying an image of cells in the field of view of the smear, an image including one cell is output. Through the technical scheme provided by the embodiment of the invention, the image needing to be output by one cell can be quickly processed and displayed.
In an embodiment of the invention, the outputting, to a display interface, the image of the different in-focus depths of the cells in at least one of the different fields of view according to the captured image of the cells in the corresponding field of view or the image of the different in-focus depths of the cells in at least one of the different fields of view includes: when outputting the image of the cells in the field of view of the smear, outputting an image including a plurality of cells. By the technical scheme provided by the embodiment of the invention, when images of a plurality of cells need to be output, focusing and shooting of the images of the plurality of cells can be quickly realized.
In one embodiment of the present invention, when outputting an image including a plurality of cells, a set type of cell (e.g., a white blood cell or a diseased cell) may be centered in the image for observation. Through the technical scheme provided by the embodiment of the invention, the set type of cells can be shown in the center of the image, so that medical staff can accurately identify the set type of cells.
In an embodiment of the present invention, the outputting, to a display interface, an image of different in-focus depths of cells in at least one of the different fields of view according to the captured image of cells in the corresponding field of view or the image of different in-focus depths of cells in at least one of the different fields of view includes: and when the image of the cells in the visual field of the smear is output, outputting an image focusing the cells meeting a preset condition, wherein the image focusing the cells meeting the definition condition can be output. The outputting the image with focusing satisfying the preset condition comprises: and automatically presenting the image of the cell which meets the preset focusing definition and is most clear in the selected area in the display area in the selected state. Through the technical scheme provided by the embodiment of the invention, in the observation process of some special target cells, the cells which need to meet certain focusing definition can be quickly focused and shot for imaging.
In one embodiment of the invention, the image display with the definition higher than the definition threshold can be searched in the images with different focusing depths formed by shooting, wherein the definition threshold can be set by the system and/or a user according to different types of cells. Through the technical scheme provided by the embodiment of the invention, images with different definitions aiming at set type cells can be independently controlled and selected.
In one embodiment of the invention, the image with the highest definition can be searched and displayed in the images with different focusing depths formed by shooting. By the technical scheme provided by the embodiment of the invention, the image with the highest definition can be automatically acquired no matter what set type of cells.
In an embodiment of the present invention, the outputting, to a display interface, an image of different in-focus depths of cells in at least one of the different fields of view according to the captured image of cells in the corresponding field of view or the image of different in-focus depths of cells in at least one of the different fields of view includes: when a selected visual field exists in the different visual fields of the smear, switching to output images of different focusing depths of cells in the selected visual field, wherein the selected visual field is the visual field selected by a user in the different visual fields of the smear or the visual field selected by the cell image processing system according to a preset rule. Through the technical scheme provided by the embodiment of the invention, the medical staff can acquire the images with different focusing depths of the required specific target cells in the observation process of some pathological cells so as to determine the characteristic information of the pathological cells and the peripheral cells.
In one embodiment of the invention, the display output device of the cell image system supports human-computer interaction, such as supporting the roller operation of a mouse, the scroll bar operation of a display window, and switching the output images in forward and reverse order through human-computer operation; by the technical scheme provided by the embodiment of the invention, circular switching output can be realized, and further, different focusing depth images can be controlled and switched to output through man-machine interaction. Thus, medical personnel no longer need to manually select the field of view and manually adjust the cell imaging system.
In one embodiment of the present invention, the switching outputs images of different in-focus depths of cells in the selected field of view, including: when a selected visual field exists in different visual fields of the smear, images of different focusing depths of cells in the selected visual field are switched and output according to human-computer interaction operation. Through the technical scheme provided by the embodiment of the invention, the images with different focusing depths of the cells in the selected visual field can be displayed on the same display interface, so that the manual and complicated manual adjustment and photographing record comparison are avoided, and the operation of medical staff is more convenient.
In one embodiment of the present invention, the switching outputs images of cells in the selected field of view at different in-focus depths, including: when the selected visual field exists in the different visual fields of the smear, the images of the cells in the selected visual field with different focusing depths are automatically switched and output. By the technical scheme provided by the embodiment of the invention, automatic switching of images displaying different focusing depths of cells in a selected visual field can be realized, the complicated operation of manual switching is avoided, and the operation speed is improved.
In one embodiment of the present invention, the automatically switching to output images of different depths of focus for cells in a selected field of view comprises: switching and outputting images with different focusing depths in a positive sequence or a negative sequence through a display output device of the cell appearance processing system; by the technical scheme provided by the embodiment of the invention, the cyclic switching output in the display output device can be realized until the display is finished, and further, images with different focusing depths can be cyclically switched and output.
In an embodiment of the present invention, the outputting, to a display interface, an image of different in-focus depths of cells in at least one of the different fields of view according to the captured image of cells in the corresponding field of view or the image of different in-focus depths of cells in at least one of the different fields of view includes: when there is a selected field of view in different fields of view of the smear, outputting images of different depths of focus formed by the selected field of view taken via the digital camera.
In an embodiment of the present invention, the outputting, to a display interface, an image of different in-focus depths of cells in at least one of the different fields of view according to the captured image of cells in the corresponding field of view or the image of different in-focus depths of cells in at least one of the different fields of view includes: and outputting an image forming a new focusing depth for the photographing.
In one embodiment of the present invention, the new image of the focus depth is formed by performing the interpolation process of the focus depth on the image formed by the digital camera shooting, for example, the distribution of the focus depth of the image formed by the digital camera shooting is: d1, D3 and D5 (sequentially increasing), the focusing depths formed by the difference values are D2 and D4, and the new focusing depths are distributed as D1, D2, D3, D4 and D5 (sequentially increasing); the problem of discontinuity caused by too small number of original images is solved, meanwhile, the shooting time of a single smear is shortened by using background interpolation of software, and the smear processing efficiency of the cell image processing system is improved. By the technical scheme provided by the embodiment of the invention, when images with different focusing depths are required, only the image with the largest focusing depth and the image with the lowest focusing depth can be shot, and the evolution process of the images with different focusing depths is obtained in an interpolation processing mode, so that the defect that the original focusing depth is not clear is made up, and the shooting time of a single smear is shortened.
In an embodiment of the present invention, the outputting, to a display interface, an image of different in-focus depths of cells in at least one of the different fields of view according to the captured image of cells in the corresponding field of view or the image of different in-focus depths of cells in at least one of the different fields of view includes: when a selected field of view exists in the different fields of view of the smear, outputting a registered image of the different in-focus depth images of the selected field of view.
In an embodiment of the invention, the image can be further displayed in a split screen mode by taking the smear as a unit, a zooming adaptive screen is carried out when one screen cannot be completely displayed, or the complete image of the smear is output in a rolling mode.
Through the technical scheme provided by the embodiment of the invention, the image of the cells in the plurality of visual fields of the smear can be output, or the image of the cells in the selected plurality of visual fields can be displayed.
In one embodiment of the invention, the process of the registration operation comprises: firstly, extracting the characteristics of two images to obtain characteristic points; finding matched feature image registration point pairs by carrying out similarity measurement; then obtaining image space coordinate transformation parameters through the matched feature point pairs; and finally, carrying out image registration by the coordinate transformation parameters. In the process of shooting images of the same cell or view field with different focusing depths, the process of vertical movement of the digital camera and the lens group can also slightly move in the horizontal direction, so that the shot images of the same cell or view field with different focusing depths cannot be strictly aligned, and the problem of alignment or alignment of the images of the same cell or view field with different focusing depths can be solved through registration processing.
Besides the registration method described in the above embodiments, there are various algorithms for image registration, such as a region-based method, a feature-based method, an image gray-scale-based registration method, and the like.
Fig. 3 is a schematic diagram of an alternative structure of a cell image processing system according to an embodiment of the present invention, and as shown in fig. 3, an alternative structure of a cell image processing system according to an embodiment of the present invention is described below with reference to the modules in fig. 3.
A receiving portion 301 for receiving one or more smears at a time.
Smear 302, stage 303, first objective 304, second objective 305, third objective 306, ocular 307, digital imaging device 308.
Wherein the digital imaging device 308 comprises: a lens group and a digital camera.
Fig. 4A is a schematic diagram illustrating an adjustment process in the cell image processing method according to the embodiment of the present invention, and as shown in fig. 4A, the lens group of the cell image processing system is implemented as a lens barrel provided with a plurality of convex lenses, centers of the convex lenses are in the same line in the lens barrel, and when the lenses of the lens group move towards the smear 404, a magnified image of the cells in a partial area of the smear 404 is formed in the visual field of the lens group. Through the technical scheme provided by the embodiment of the invention, the formation of an enlarged image of one cell or a plurality of cells in a visual field can be realized. Further, the lenses in the lens group are of plastic lens (plastic lens) and glass lens (glass lens) types, and different lens groups are combined to form different magnifications, such as 10 times, 40 times, 100 times, and the like.
In an embodiment of the invention, the number of the lenses of the cell image processing system is multiple, the lenses can be arranged on a turntable, the lens group facing the smear is switched by the rotation of the turntable to form the vision fields with different magnifications of the smear 404, for example, the region where the smear is located is found by a low power lens, and after the region where the smear is located, the high power lens is switched by rotating the turntable, so as to check the vision field with higher magnification. According to the technical scheme provided by the embodiment of the invention, as the number of the lens groups of the cell image processing system is multiple, the lens combination adaptive to the target cell can be timely switched aiming at different target cells, so that the clearest image aiming at the target cell can be obtained.
Fig. 4B is a schematic diagram illustrating an adjustment process in the cell image processing method according to the embodiment of the invention, as shown in fig. 4B, wherein the first objective lens 401 corresponds to the first objective lens 304 in fig. 3, the second objective lens 402 corresponds to the second objective lens 305 in fig. 3, the third objective lens 403 corresponds to the third objective lens 306 in fig. 3, the smear 404 corresponds to the smear 302 in fig. 3, and the stage 405 corresponds to the stage 303 in fig. 3.
As shown in FIG. 4B, during use of the cellular image processing system, an automatic placement device is configured to place the smear into an imaging position of the lens assembly. Can realize the automatic placement of the smear, and when the number of the smears to be analyzed is large, the automatic placement of the smear is realized, so that the processing speed of the system can be increased, and the workload of medical staff is reduced.
Fig. 4C is a schematic diagram of an adjustment process in the cell image processing method according to the embodiment of the invention, as shown in fig. 4C, when power can be transmitted to the digital imaging device, the digital camera performs parallel movement with respect to the plane of the smear 404, for example, transverse and/or longitudinal movement with respect to the plane of the smear 404, so that the lenses of the lens group can cover the whole area of the smear 404 with cells, and during the movement, different fields of view are formed for shooting, thereby forming a complete image of the whole area of the smear 404 with cells. Through the technical scheme provided by the embodiment of the invention, the digital camera can move in parallel relative to the plane where the smear 404 is located, and different formed visual fields are shot in the moving process so as to obtain a complete image of the whole area coated with cells in the smear.
Fig. 4D is a schematic diagram of an adjustment process in the cell image processing method according to the embodiment of the invention, as shown in fig. 4D, when power is transmitted to the digital imaging device, the digital camera moves vertically relative to the plane where the smear 404 is located, for example, moves away from or approaches to the plane where the smear 404 is located, the moving distance is small enough (micrometer level), so as to ensure that the form of the field of view of imaging is not affected, and at the same time, different focusing depths can be adjusted, and the digital camera photographs the different formed fields of view to form a complete image of the whole area of the smear 404 with cells. Through the technical scheme provided by the embodiment of the invention, the digital camera can move in the vertical direction relative to the plane where the smear 404 is located, different formed visual fields are shot in the moving process to obtain the complete image of the whole area where the cells are smeared in the smear 404, and the focal depth is changed due to the adjustment in the vertical direction, so that the obtained complete image of the whole area where the cells are smeared in the smear 404 can be the complete image of the whole area where the cells correspond to different focal depths.
In an embodiment of the invention, the outputting, to a display interface, the image of the different in-focus depths of the cells in at least one of the different fields of view according to the captured image of the cells in the corresponding field of view or the image of the different in-focus depths of the cells in at least one of the different fields of view includes: and when the image of the cells in the visual field of the smear is output, outputting the image with focusing definition meeting the definition condition. Through the technical scheme provided by the embodiment of the invention, in the observation process of some special target cells, the cells which need to meet certain focusing definition can be quickly focused and shot for image presentation.
FIG. 5A is a schematic diagram illustrating an image display in the cell image processing method according to the embodiment of the present invention, as shown in FIG. 5A, the images of the cells in the plurality of fields of the smear can be output to the display interface at one time; preferably, the target cells in each image are in a non-edge location of the image (e.g., in a central region) for easy viewing by the user. Through the technical scheme provided by the embodiment of the invention, medical staff can conveniently observe the images of the cells in a plurality of visual fields of the smear at one time on one display interface, and the statistics of the proportion of the pathological cells is more convenient.
5B 1-5B 5 are diagrams showing an example of an image in the cell image processing method according to the embodiment of the invention, and as shown in FIGS. 5B 1-5B 5, the display output device 103 is further configured to output the image with the highest resolution corresponding to the selected region when the partial region of one of the cell images with different focusing depths of the at least one field of view is selected, where the image with the highest resolution corresponding to the selected region of the one of the cell images may be the other of the cell image or the cell image with different focusing depths. As shown, when a portion within the circular selection box of the image 5B-1 is selected, the image 5B-3 with the highest sharpness corresponding to the selected region may be selected among the corresponding images 5B-2 to 5B-5 with different focusing depths, and the image 5B-3 may be presented; if the display interface presents one image at a time, if the image 5B-1 is presented and the part of the circular selection box of the image 5B-1 is selected, the other image 5B-3 with the highest corresponding definition of the selected area is automatically switched to be presented; if the display interface presents a plurality of images with different focusing depths of a cell or a visual field at one time, for example, images 5B-1, 5B-2, 5B-3 and 5B-4 with different focusing depths of a certain cell or a visual field are displayed in parallel, and a part of a circular selection frame of the image 5B-1 is selected, the image 5B-3 with the highest corresponding definition in the selected area is highlighted or enlarged to prompt a user to view the image with the highest corresponding definition in the selected area.
5C 1-5C 4 are diagrams showing an example of an image in the cell image processing method according to the embodiment of the present invention, and as shown in FIGS. 5C 1-5C 4, the display output device 103 is further configured to switch to output images of different focusing depths of cells in different fields of view of the smear when the selected field of view exists in the different fields of view. Images of different in-focus depths have differences in the sharpness of the images in different display areas. As shown in fig. 5C 1-5C 4, the particles of the displayed cell images within the three selection boxes of fig. 5C-1 are most clear; FIG. 5C-2 shows the cell image displayed within the selection box to the left of the cell nucleus with the particles most clear; FIG. 5C-3 shows the cell image shown within the selection box in the middle of the nucleus with the particles most clear; the particles of the cell image shown in the nuclear position of the cell in FIG. 5C-3 are most clear. Through the technical scheme provided by the embodiment of the invention, the images with different focusing depths of the required specific target cells can be acquired in the observation process of the medical staff on certain pathological cells, so as to determine the characteristic information of the pathological cells and the peripheral cells.
5D 1-5D 2 are diagrams of an example of an image processing method for a cell provided by an embodiment of the present invention, and as shown in FIGS. 5D 1-5D 2, the display output device 103 is further configured to output a registered image of different in-focus depth images of a selected field of view when the selected field of view exists in the different fields of view of the smear. Wherein, fig. 5D-1 is an unregistered image, fig. 5D-2 is a registered image, and since the process of vertical movement of the digital camera and the lens group may also occur in the horizontal direction during the process of capturing images of different focusing depths of the same cell or field of view, the captured images of different focusing depths of the same cell or field of view may not be exactly aligned, and the problem of alignment of images of different focusing depths of the same cell or field of view may be solved by the registration process.
Fig. 5E 1-5E 6 are diagrams illustrating an example of an image in the cell image processing method according to the embodiment of the invention, and as shown in fig. 5E 1-5E 6, when the cell image processing system is in the depth of field mode, the display output device 103 is configured to output a plurality of images of cells with different focusing depths to the display interface. Wherein, fig. 5E1 to 5E6 are cell images with 6 different focusing depths, the image definitions of fig. 5E1 to 5E6 are sequentially enhanced, and the overall cell shape of fig. 5E6 is the clearest.
Fig. 5F 1-5F 6 are diagrams illustrating an example of one image in the cell image processing method according to the embodiment of the invention, and as shown in fig. 5F 1-5F 6, when the cell image processing system is in the depth of field mode, the display output device 103 is configured to output a plurality of images of another cell with different focusing depths to the display interface. Wherein, fig. 5F1 to 5F6 are cell images with 6 different focusing depths, the image definitions of fig. 5F1 to 5F6 are sequentially enhanced, and the overall shape of the cell nucleus of fig. 5F6 is most clear, which is convenient for observation.
Fig. 6 is a schematic diagram of an alternative configuration of the cell image processing system according to the embodiment of the present invention, and as shown in fig. 6, the cell image processing system 600 may be a portable analyzer, a medical device with a cell image processing function, or the like. The cell image processing system 600 shown in fig. 6 includes: at least one processor 601, memory 602, at least one network interface 604, and a user interface 603. The various components in the cell image processing system 600 are coupled together by a bus system 605. It is understood that the bus system 605 is used to enable connected communication between these components. The bus system 605 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 605 in fig. 6.
The user interface 603 may include, among other things, a display, a keyboard, a mouse, a trackball, a click wheel, a key, a button, a touch pad, or a touch screen.
It will be appreciated that the memory 602 can be either volatile memory or nonvolatile memory, and can include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a magnetic random access Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration, and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), synchronous Static Random Access Memory (SSRAM), dynamic Random Access Memory (DRAM), synchronous Dynamic Random Access Memory (SDRAM), double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), double Data Rate Synchronous Random Access Memory (ESDRAM), enhanced Synchronous Dynamic Random Access Memory (ESDRAM), enhanced Synchronous Random Access Memory (DRAM), synchronous Random Access Memory (DRAM), direct Random Access Memory (DRmb Access Memory). The memory 602 described in connection with the embodiments of the invention is intended to comprise these and any other suitable types of memory.
The memory 602 in the present embodiment includes, but is not limited to: ternary content addressable memory, static random access memory, etc. are capable of storing various types of data such as cell images, tuning parameters, system tuning parameters, etc. to support the operation of cell image processing system 600. Examples of such data include: any computer programs for operating on the cell image processing system 600, such as an operating system 6021 and application 6022, storing power data, usage records, adjustment rules, and the like. The operating system 6021 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, for implementing various basic services and processing hardware-based tasks. Applications 6022 may include various applications, such as a client with cellular image processing capabilities, or applications, etc., for implementing the method including adjusting the relative position of the digital imaging device and smear based on mechanical actuation; and controlling the digital camera to move in a parallel direction relative to the plane of the smear, and shooting various application businesses including images of cells in corresponding fields of view through different fields of view in the smear formed by the lens group. A program for implementing the cell image processing method according to the embodiment of the present invention may be included in the application program 6022.
The method disclosed by the above-mentioned embodiment of the present invention can be applied to the processor 601, or implemented by the processor 601. The processor 601 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the method may be implemented by integrated logic circuits of hardware or operations in the form of software in the processor 601. The Processor 601 may be a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. Processor 601 may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed by the embodiment of the invention can be directly implemented by a hardware decoding processor, or can be implemented by combining hardware and software modules in the decoding processor. The software modules may be located in a storage medium located in the memory 602, and the processor 601 reads the information in the memory 602 and performs the steps of the aforementioned methods in conjunction with its hardware.
In an exemplary embodiment, the cell image processing system 600 may be implemented by one or more Application Specific Integrated Circuits (ASICs), DSPs, programmable Logic Devices (PLDs), complex Programmable Logic Devices (CPLDs), field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro Controllers (MCUs), microprocessors (microprocessors), or other electronic components configured to perform the cell image processing method.
In an exemplary embodiment, the present invention further provides a computer readable storage medium, such as a memory 602 including a computer program, which is executable by the processor 601 of the cell image processing system 600 to perform the steps of the foregoing method. The computer readable storage medium can be Memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash Memory, magnetic surface Memory, optical disk, or CD-ROM; or may be various devices, such as a portable analyzer, etc., including one or any combination of the above-described memories.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, performs: adjusting the relative position of the digital imaging device and the smear based on mechanical transmission, and executing:
adjusting the relative position of the digital imaging device and the smear;
in response to a parallel-direction movement of a digital camera relative to the plane of the smear, taking images of cells in respective fields of view through different fields of view in the smear formed by a lens group;
taking images of different depths of focus of cells in at least one of the different fields of view formed by the lens group in response to vertical movement of the digital camera relative to the plane of the smear;
outputting, to a display interface, images of different in-focus depths of cells in at least one of the different fields of view.
Fig. 7 is an alternative structural diagram of an automatic film reading device according to an embodiment of the present invention, and as shown in fig. 7, an alternative structural diagram of an automatic film reading device according to an embodiment of the present invention is described below with reference to modules in fig. 7.
A receiving device 701 configured to receive images of different in-focus depths of cells in at least one of different fields of view acquired when the digital imaging device photographs the smear;
the digital imaging device can be independent of the film reading device, and the digital imaging device can be represented by a microscope or any device with a function of shooting cell images; the digital imaging device may capture images of different in-focus depths of cells in at least one of the different fields of view.
Images of different in-focus depths of cells in at least one of the different fields of view taken by the digital imaging device may be transmitted to the receiving device 701.
A display device 702 configured to output to a display interface images of different in-focus depths of cells in at least one of the different fields of view.
In one embodiment of the present invention, the automatic film reading apparatus comprises a normal mode and a depth of field mode, wherein,
when the automatic film reading device is in a common mode, the display device displays or outputs the clearest image in the images with different focusing depths of the cells in each visual field; when the automatic film reading device is in the depth of field mode, the display device can output a plurality of images of the same field of view or different focusing depths of cells. The user can flexibly select the working mode according to the working environment of the automatic film reading device.
In an embodiment of the invention, the display output device is further configured to output a plurality of images of different focusing depths of the cells in at least one of the different fields of view simultaneously or dynamically. Through the flexible selection of a plurality of image output modes with different focusing depths of the cells in at least one of different visual fields, a user can flexibly select the corresponding output mode according to the types of the observed cells.
In an embodiment of the present invention, the display output apparatus is further configured as the display output apparatus, and further configured to: when the cells in at least one of the different visual fields are judged to be normal cells, outputting at least one image which accords with preset definition of the normal cells to the display interface, preferably, when the cells in at least one of the different visual fields are judged to be normal cells, outputting an image which is shot for the normal cells and has the highest definition to the display interface; when the cell in at least one of the different visual fields is judged to be an abnormal cell, outputting images of the abnormal cell with different focusing depths to the display interface. During operation of the display Device 702, the display Device 702 can be further configured to determine whether the cell is normal, and at this time, the process of identifying the cell by the display Device 702 can be performed by a Controller included in the display Device 702, wherein the Controller can be implemented in the form of one or more Application Specific Integrated Circuits (ASICs), DSPs, programmable Logic Devices (PLDs), complex Programmable Logic Devices (CPLDs), field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro Controllers (MCUs), microprocessors (microprocessors), or other electronic elements configured to perform the function of determining whether the cell is normal.
In one embodiment of the present invention, the display output device further configured to: when the diameter or the projection area presented by the cell is judged to exceed a first preset threshold value, outputting the images of the cell with different focusing depths;
and when the diameter or the projection area of the cell is judged to be smaller than a second preset threshold value, outputting an image with the highest definition shot for the cell.
In one embodiment of the present invention, when the presented area of the cell exceeds a first preset threshold, the display device 702 is configured to output images of the cell at different focusing depths; when the diameter or the projected area of the cell is smaller than a second preset threshold, the display device 702 is configured to output the image with the highest definition captured for the cell; the first preset threshold is greater than or equal to the second preset threshold. For example, the first preset threshold is 20 micrometers, and the second preset threshold is 10-15 micrometers, by using the technical scheme provided by the embodiment of the present invention, different display modes can be adopted for different cells to be detected, and when the cells to be detected are primitive cells (naive primitive cells), the images with different focusing depths can be timely output so as to facilitate detection by a user.
In one embodiment of the invention, the display output device is further configured to output images of the cells in the plurality of fields of view of the smear to the display interface at once; through the technical scheme provided by the embodiment of the invention, medical staff can conveniently observe the images of the cells in a plurality of visual fields of the smear at one time on one display interface, and the statistics of the proportion of the pathological cells is more convenient.
In one embodiment of the invention, the display output device is further configured to output the image of the cells in any one field of view of the smear to the display interface at a time. Through the technical scheme provided by the embodiment of the invention, the medical staff can acquire the images with different focusing depths of the required specific target cells in the observation process of some pathological cells so as to determine the characteristic information of the pathological cells and the peripheral cells.
In one embodiment of the invention, the display device 702 is further configured to output an image including one cell at a time or an image including a plurality of cells at a time when outputting an image of cells in the field of view of the smear. By the technical scheme provided by the embodiment of the invention, the processing and display of the image of one cell needing to be output can be realized, and further, the focusing and shooting of the images of a plurality of cells can be realized quickly when the images of a plurality of cells need to be output.
In an embodiment of the present invention, the display device 702 is further configured to output an image with focusing satisfying a preset condition when outputting an image of cells in the field of view of the smear, wherein the output may be an image with focusing definition satisfying definition condition. The outputting the image with focusing satisfying the preset condition comprises: and automatically presenting the image of the cell which meets the preset focusing definition and is most clear in the selected area in the display area in the selected state. Through the technical scheme provided by the embodiment of the invention, in the observation process of some special target cells, the cells which need to meet certain focusing definition can be quickly focused and shot for image presentation.
In one embodiment of the invention, the display device 702 is further configured to switch output of the images of the cells in the selected field of view at different depths of focus when the selected field of view is present in the different fields of view of the smear. Through the technical scheme provided by the embodiment of the invention, the medical staff can acquire the images with different focusing depths of the required specific target cells in the observation process of some pathological cells so as to determine the characteristic information of the pathological cells and the peripheral cells.
In an embodiment of the present invention, the display device 702 is further configured to switch to output images of different focusing depths of cells in a selected field of view according to a human-computer interaction operation when the selected field of view exists in different fields of view of the smear. By the technical scheme provided by the embodiment of the invention, circular switching output can be realized, and further, different focusing depth images can be controlled and switched to output through man-machine interaction. Thus, medical personnel no longer need to manually select a field of view, nor manually adjust the cellular image system.
In one embodiment of the invention, the display device 702 is further configured to automatically switch to output images of different in-focus depths of cells in a selected field of view when the selected field of view is present in different fields of view of the smear. By the technical scheme provided by the embodiment of the invention, automatic switching of images displaying different focusing depths of cells in a selected visual field can be realized, the complicated operation of manual switching is avoided, and the operation speed is improved.
In one embodiment of the invention, the display device 702 is further configured to output images of different focus depths formed by the selected field of view taken via the digital camera when the selected field of view is present in the different fields of view of the smear and to output images of new focus depths formed for the taken.
In one embodiment of the present invention, the new image with the focus depth is formed by performing the interpolation processing of the focus depth on the image captured and formed by the external digital imaging device, for example, the distribution of the focus depth of the captured and formed image is: d1, D3 and D5 (sequentially increasing), the focusing depths formed by the difference values are D2 and D4, and the new focusing depths are distributed as D1, D2, D3, D4 and D5 (sequentially increasing); the problem of discontinuity caused by too small number of original images is solved, meanwhile, the shooting time of a single smear is shortened by using background interpolation of software, and the smear processing efficiency of the cell image processing system is improved. By the technical scheme provided by the embodiment of the invention, when images with different focusing depths are required, only the image with the largest focusing depth and the image with the lowest focusing depth can be shot, and the evolution process of the images with different focusing depths is obtained in an interpolation processing mode, so that the defect that the original focusing depth is not clear is made up, and the shooting time of a single smear is shortened.
In one embodiment of the present invention, when outputting an image including a plurality of cells, a set type of cell (e.g., a white blood cell or a diseased cell) may be centered in the image for observation. Through the technical scheme provided by the embodiment of the invention, the cell of the set type can appear in the center of the image, so that medical personnel can accurately identify the cell of the set type.
In one embodiment of the invention, the display device 702 is further configured to output a registered image of different in-focus depth images of a selected field of view of the smear when the selected field of view is present in the different fields of view.
In an embodiment of the present invention, the display device 702 includes a display output interface for outputting a signal corresponding to the image to an external device.
In an embodiment of the present invention, the display apparatus 702 further includes a display device, connected to the display output interface, for receiving the signal output by the display output interface and displaying an image correspondingly.
In the embodiment of the invention, the automatic film reading device can be a film reader, a blood cell digital image analysis system and other devices, and is different from the traditional manual microscopic examination mode, the sample smeared on the smear does not need to be observed and analyzed manually through a microscope, the digital image of the cell can be directly observed through the automatic film reading device, and the microscopic examination efficiency and the convenience for viewing the microscopic examination result are improved.
Fig. 8 is an alternative structure diagram of a sheet reader according to an embodiment of the present invention, and as shown in fig. 8, the sheet reader 800 may be a portable analyzer, a medical device with a cell image processing function, or the like. The film reader 800 shown in fig. 8 includes: at least one processor 801, memory 802, at least one network interface 804, and a user interface 803. The various components in the reader 800 are coupled together by a bus system 805. It is understood that the bus system 805 is used to enable communications among the components connected. The bus system 805 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 805 in FIG. 8.
The user interface 803 may include, among other things, a display, a keyboard, a mouse, a trackball, a click wheel, a key, a button, a touch pad, or a touch screen.
It will be appreciated that the memory 802 can be either volatile memory or nonvolatile memory, and can include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a magnetic random access Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), synchronous Static Random Access Memory (SSRAM), dynamic Random Access Memory (DRAM), synchronous Dynamic Random Access Memory (SDRAM), double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), enhanced Synchronous Dynamic Random Access Memory (ESDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), synchronous Dynamic Random Access Memory (SLDRAM), direct Memory (DRmb Access), and Random Access Memory (DRAM). The memory 802 described in connection with the embodiments of the invention is intended to comprise these and any other suitable types of memory.
Memory 802 in embodiments of the present invention includes, but is not limited to: the ternary content addressable memory, static random access memory, can store a wide variety of data such as a received cell image to support the operation of the reader 800. Examples of such data include: any computer program for operating on the film reader 800, such as an operating system 8021 and application programs 8022, storing image data, usage records, adjustment rules, and the like. Operating system 8021 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, for implementing various basic services and processing hardware-based tasks. The application 8022 may include various applications, such as a client with a smear reading function, or an application, etc., for implementing the method including receiving images of different focusing depths of cells in at least one of different fields of view acquired when the digital imaging device photographs a smear; outputting to a display interface various application services including images of different in-focus depths of cells in at least one of the different fields of view. The program for implementing the corresponding operation of the film reading of the embodiment of the present invention can be included in the application program 8022.
The method disclosed in the above embodiments of the present invention may be applied to the processor 801 or implemented by the processor 801. The processor 801 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the method may be implemented by integrated logic circuits of hardware or operations in the form of software in the processor 801. The Processor 801 may be a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc. Processor 801 may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed by the embodiment of the invention can be directly implemented by a hardware decoding processor, or can be implemented by combining hardware and software modules in the decoding processor. The software modules may be located in a storage medium located in the memory 802, and the processor 801 reads the information in the memory 802 to complete the corresponding steps described above in connection with its hardware.
In an exemplary embodiment, the cell image processing system 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), DSPs, programmable Logic Devices (PLDs), complex Programmable Logic Devices (CPLDs), field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro Controllers (MCUs), microprocessors (microprocessors), or other electronic components configured to perform the cell image processing method.
In an exemplary embodiment, the present invention further provides a computer readable storage medium, such as a memory 802 comprising a computer program, which is executable by the processor 801 of the cell image processing system 800 to perform the steps of the aforementioned method. The computer readable storage medium can be Memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash Memory, magnetic surface Memory, optical disk, or CD-ROM; or may be various devices, such as a portable analyzer, etc., including one or any combination of the above-described memories.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, performs: adjusting the relative position of the digital imaging device and the smear based on mechanical transmission, and executing:
receiving images of different focusing depths of cells in at least one of different fields of view acquired by a digital imaging device when a smear is photographed; to output to a display interface images of different in-focus depths of cells in at least one of the different fields of view.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, embodiments of the present invention may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including magnetic disk storage, optical storage, and the like) having computer-usable program code embodied in the medium.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program operations. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the operations performed by the processor of the computer or other programmable data processing apparatus produce means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program operations may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the operations stored in the computer-readable memory produce an article of manufacture including operating means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program operations may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the operations executed on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only exemplary of the present invention and should not be taken as limiting the scope of the present invention, and any modifications, equivalents, improvements, etc. that are within the spirit and principle of the present invention should be included in the present invention.

Claims (33)

1. A cell image processing system, comprising:
a control device configured to adjust the relative position of the digital imaging device and the smear;
the digital imaging device comprises a lens group and a digital camera;
wherein the content of the first and second substances,
the control device controls at least one of the digital imaging device and the smear so that the digital imaging device and the smear move relatively in the horizontal direction of the plane where the smear is located, the digital camera shoots different fields of view in the smear formed by the lens group, and when the fields of view are shot, the digital camera focuses on cells in the fields of view and shoots images of the cells in the corresponding fields of view;
the control device controls at least one of the digital imaging device and the smear so that the digital imaging device and the smear move relatively in the vertical direction of the plane where the smear is located to focus cells in corresponding fields of view at different focusing depths, and the digital camera shoots the cells at different focusing depths to obtain cell images at different focusing depths;
a display output device configured to output the cell images of different focusing depths of the at least one field of view to a display interface;
wherein the cell is a leukocyte or a diseased cell.
2. The cell image processing system according to claim 1, wherein the cell image processing system includes a normal mode and a depth of field mode, wherein,
when the cell image processing system is in a common mode, the display output device is configured to output one image with highest definition in images with different focusing depths of the cells to the display interface;
when the cell image processing system is in a depth of field mode, the display output device is configured to output a plurality of images of different in-focus depths of the cells to the display interface.
3. The cellular image processing system according to any one of claims 1 to 2,
the display output device is further configured to simultaneously output a plurality of images of different in-focus depths of cells in the at least one field of view, or,
dynamically outputting a plurality of images of different in-focus depths of cells in the at least one field of view.
4. The cellular image processing system according to any one of claims 1 to 3, wherein the display output device is further configured to:
when the shot cells are judged to be normal cells, outputting images with highest definition shot for the normal cells to the display interface;
and when the shot cells are judged to be abnormal cells, outputting images of different focusing depths of the abnormal cells to the display interface.
5. The cellular image processing system according to claim 1, wherein the control device is configured to set a range of focusing depths, or,
is configured to set a difference in focus depth of images of different focus depths of the at least one field of view, the difference in focus depth of each two adjacent images among the images of different focus depths being the same or different.
6. The cellular image processing system according to claim 1,
the display output device is further configured to:
when the diameter or the projection area of the shot cell exceeds a first preset threshold value, outputting images of the cell with different focusing depths;
and when the diameter or the projection area of the shot cell is smaller than a second preset threshold value, outputting the image with the highest definition shot for the cell.
7. The cellular image processing system according to any one of claims 1 to 6, wherein the cellular image processing system further includes:
an automatic placement device configured to receive the smear and convey the smear to an imaging position of the lens group.
8. The cellular image processing system according to any one of claims 1 to 7, wherein the display output device is further configured to output the image with the highest resolution corresponding to the selected region when the partial region of one image of the cellular images of different in-focus depths of the at least one field of view is selected.
9. The cellular image processing system according to any one of claims 1 to 8,
the display output device is also configured to switch and output images of different focusing depths of cells in a selected visual field, wherein the selected visual field is a visual field selected by a user in different visual fields of the smear to be shot or a visual field selected by the cell image processing system according to a preset rule.
10. The cell image processing system according to claim 9,
the display output device is further configured to switch and output images with different focusing depths of the cells in the selected visual field according to human-computer interaction operation.
11. The cellular image processing system according to claim 9,
the display output device is also configured to automatically switch and output images with different focusing depths of cells in the selected visual field according to a preset switching speed or a preset switching time.
12. The cellular image processing system according to any one of claims 1 to 11,
the display output device is further configured to output a registered image of different in-focus depth images of the captured cell.
13. The cell image processing system according to claim 1,
the display output device comprises a display output interface configured to output a signal corresponding to the image to an external device.
14. The cell image processing system according to claim 13,
the display output device also comprises a display device which is connected with the display output interface and is configured to receive the signal output by the display output interface and correspondingly display the image.
15. A cell image processing method applied to an image processing system includes:
adjusting the relative position of the digital imaging device and the smear;
in response to the parallel-direction movement of a digital camera relative to the plane of the smear, the digital camera takes pictures of different fields of view in the smear formed by a lens group, while taking pictures of the fields of view, the digital camera focuses on the cells in the fields of view taking pictures of the cells in the respective fields of view;
in response to the vertical movement of the digital camera relative to the plane of the smear, at least one field of view in different fields of view in the smear formed by the lens group, the digital camera focuses the cells in the corresponding field of view at different focusing depths, and the digital camera shoots the cells at different focusing depths to obtain cell images at different focusing depths;
outputting the cell images of the different fields of view to a display interface, wherein the cell images of the different fields of view include: cell images of different in-focus depths of at least one of the different fields of view;
wherein the cell is a leukocyte or a diseased cell.
16. The method of claim 15, wherein the cellular image processing system includes a normal mode and a depth of field mode, wherein,
when the cell image processing system is in a common mode, outputting an image with highest definition in images with different focusing depths of the photographed cell to the display interface;
and when the cell image processing system is in the depth of field mode, outputting a plurality of images of at least one photographed cell with different focusing depths to the display interface.
17. The method of any of claims 15-16, wherein said outputting to a display interface images of different in-focus depths of cells in at least one of the different fields of view comprises:
simultaneously outputting a plurality of images of cells in at least one field of view at different depths of focus, or,
a plurality of images of different in-focus depths of cells in at least one field of view are dynamically output.
18. The method according to any one of claims 15-17, wherein the method comprises:
identifying whether there is an abnormality in the cells in the different fields of view;
when the shot cells are recognized to be normal cells, outputting images with highest definition shot for the normal cells to the display interface;
and when the shot cells are identified to be abnormal cells, outputting images of the abnormal cells with different focusing depths to the display interface.
19. The method of claim 15, wherein the method further comprises:
the range of the focusing depth is set, or,
setting a difference in focus depth of images of different focus depths of the at least one field of view, the difference in focus depth of each two adjacent images among the images of different focus depths being the same or different.
20. The method of claim 15, wherein the method further comprises:
recognizing the morphology of the cell;
when the diameter or the projection area presented by the cell exceeds a first preset threshold value, outputting images of the cell with different focusing depths;
and when the diameter or the projection area of the cell is smaller than a second preset threshold value, outputting the image with the highest definition shot on the cell.
21. The method according to any one of claims 15-20, wherein the method further comprises:
and before the relative position of the digital imaging device and the smear is adjusted, conveying the smear to the imaging position of the lens group.
22. The method of claim 15, wherein the method further comprises:
and outputting the image with the highest definition corresponding to the selected area when the partial area of one image of the cell images with different focusing depths of the at least one field of view is selected.
23. The method of any of claims 15-20, wherein said outputting to a display interface images of different in-focus depths of cells in at least one of said different fields of view comprises:
when at least one selected field exists in different fields of the smear, switching to output images of different in-focus depths of cells in the selected at least one field; the at least one selected field of view is a field of view selected by a user among different fields of view in which the smear is taken or a field of view selected by the cellular image processing system according to a preset rule.
24. The method of claim 23, wherein said switching outputs images of different in-focus depths of cells in the selected at least one field of view, comprising:
switching and outputting images of different focusing depths of cells in the selected at least one field of view according to the man-machine interaction operation; or
And automatically switching and outputting images of different focusing depths of the cells in the at least one selected field of view according to the preset switching speed or the preset switching time.
25. The method of any of claims 15-24, wherein said outputting to a display interface images of different in-focus depths of cells in at least one of the different fields of view comprises:
when there is at least one selected field of view in the different fields of view of the smear, outputting a registered image of the different in-focus depth images of the at least one selected field of view.
26. An automatic film reading apparatus comprising:
the receiving device is configured to receive images of different focusing depths of cells in at least one visual field acquired when the digital imaging device shoots the smear; the digital imaging device and the smear move relatively in the horizontal direction of the plane of the smear, a digital camera shoots different fields of view in the smear formed by a lens group, and when the fields of view are shot, the digital camera focuses on cells in the fields of view and shoots images of the cells in the corresponding fields of view; the digital imaging device and the smear move relatively in the vertical direction of the plane where the smear is located so as to focus cells in corresponding fields at different focusing depths, and the digital camera shoots the cells at different focusing depths to obtain cell images at different focusing depths; the cells are leukocytes or diseased cells;
a display device configured to output to a display interface images of different in-focus depths of cells in at least one of the different fields of view.
27. The automatic film reading device according to claim 26, wherein the automatic film reading device comprises a normal mode and a depth of view mode,
when the automatic film reading device is in a common mode, the display device is configured to output one image with the highest definition in the images with different focusing depths of the cells to the display interface;
when the automatic film reading device is in a depth of field mode, the display device is configured to output a plurality of cell images of cells with different focusing depths to the display interface.
28. The automatic film reading apparatus according to claim 26,
the display device is further configured to simultaneously output a plurality of images of different in-focus depths of cells in at least one of the different fields of view, or,
dynamically outputting a plurality of images of different in-focus depths of cells in at least one of the different fields of view.
29. The automatic film reading apparatus according to claim 26,
the display device is further configured to:
when the cell in at least one of the different visual fields is judged to be a normal cell, outputting an image with the highest definition for shooting the normal cell to the display interface;
when the cell in at least one of the different visual fields is judged to be an abnormal cell, outputting images of different focusing depths of the abnormal cell to the display interface.
30. The automatic sheet reading apparatus according to any one of claims 26 to 29,
the display device is further configured to:
when the diameter or the projection area presented by the cell in at least one of the different fields of view is judged to exceed a first preset threshold value, outputting the images of the cell with different focusing depths;
and when the diameter or the projection area of the cell in at least one of the different fields of view is judged to be smaller than a second preset threshold value, outputting an image with the highest definition shot on the cell.
31. The automatic sheet reading apparatus according to any one of claims 26 to 30,
and the display device is also configured to output images of different focusing depths of cells in the selected visual field according to human-computer interaction operation or automatic switching when the selected visual field exists in different visual fields of the smear.
32. A cell image processing system, the cell image processing system comprising:
a memory configured to store executable instructions;
a processor configured to execute the executable instructions stored in the memory to perform the method of processing a cell image according to any one of claims 15 to 25.
33. A storage medium storing executable instructions configured to cause a processor to perform the method of cell image processing of any one of claims 15 to 25 when the executable instructions are executed.
CN201880088257.3A 2018-07-13 2018-07-13 Cell image processing system, cell image processing method, automatic film reading device and storage medium Active CN111656247B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211549964.2A CN116088158A (en) 2018-07-13 2018-07-13 Cell image processing system, method, automatic film reading device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/095707 WO2020010634A1 (en) 2018-07-13 2018-07-13 Cell image processing system and method, automatic smear reading device, and storage medium

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202211549964.2A Division CN116088158A (en) 2018-07-13 2018-07-13 Cell image processing system, method, automatic film reading device and storage medium

Publications (2)

Publication Number Publication Date
CN111656247A CN111656247A (en) 2020-09-11
CN111656247B true CN111656247B (en) 2023-03-10

Family

ID=69143205

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202211549964.2A Pending CN116088158A (en) 2018-07-13 2018-07-13 Cell image processing system, method, automatic film reading device and storage medium
CN201880088257.3A Active CN111656247B (en) 2018-07-13 2018-07-13 Cell image processing system, cell image processing method, automatic film reading device and storage medium

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202211549964.2A Pending CN116088158A (en) 2018-07-13 2018-07-13 Cell image processing system, method, automatic film reading device and storage medium

Country Status (2)

Country Link
CN (2) CN116088158A (en)
WO (1) WO2020010634A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114152610B (en) * 2021-11-02 2023-06-27 桂林优利特医疗电子有限公司 Slide cell scanning method based on visual target mark
CN113793336B (en) * 2021-11-17 2022-03-11 成都西交智汇大数据科技有限公司 Method, device and equipment for detecting blood cells and readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201104252A (en) * 2009-07-20 2011-02-01 Yaya Tech Co Ltd Cell detecting apparatus
CN103813094A (en) * 2012-11-06 2014-05-21 联发科技股份有限公司 Electronic device and related method capable of capturing images, and machine readable storage medium
CN105122037A (en) * 2013-06-07 2015-12-02 富士施乐株式会社 Image processing system, image processing device, program, storage medium, and image processing method
CN106896489A (en) * 2017-02-13 2017-06-27 清华大学 Frequency domain based on wavelength multiplexing pieces microscopic system and its method together

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1389553A (en) * 1972-05-23 1975-04-03 Legorreta G Apparatus for investigating microscopic particles
WO2003102210A2 (en) * 2002-05-30 2003-12-11 The Johns Hopkins University Techniques for automated diagnosis of cell-borne anomalies with a digital optical microscope
JP4346923B2 (en) * 2003-02-21 2009-10-21 晴夫 高林 Target cell automatic search system
FR2931966A1 (en) * 2008-05-30 2009-12-04 Novacyt METHOD FOR CELLULAR ANALYSIS OF A SAMPLING USING A VIRTUAL ANALYSIS PLATE
JP5364430B2 (en) * 2009-04-22 2013-12-11 オリンパス株式会社 Cell image acquisition apparatus and cell image acquisition method
KR20160103175A (en) * 2011-07-19 2016-08-31 오비지오 이미징 시스템스 엔.브이. A method and system for detecting and/or classifying cancerous cells in a cell sample
JP5705096B2 (en) * 2011-12-02 2015-04-22 キヤノン株式会社 Image processing apparatus and image processing method
US9557549B2 (en) * 2011-12-09 2017-01-31 Massachusetts Institute Of Technology Systems and methods for self-referenced quantitative phase microscopy
JP5464244B2 (en) * 2012-08-24 2014-04-09 富士ゼロックス株式会社 Image processing apparatus, program, and image processing system
JP6070420B2 (en) * 2013-05-31 2017-02-01 富士ゼロックス株式会社 Image processing apparatus and program
US9347082B2 (en) * 2014-08-28 2016-05-24 Omnivision Technologies, Inc. Automated cell growth/migration detection system and associated methods
CN204924899U (en) * 2015-08-31 2015-12-30 广西师范大学 Unicellular image extraction detection device
CN106772975B (en) * 2017-01-19 2019-08-13 宁波纳美致生物科技有限公司 For the lighting system of cell or tissue different depth super-resolution micro-imaging
CN207114871U (en) * 2017-09-14 2018-03-16 杭州键一生物科技有限公司 Intelligent microscope focal adjustment device in full-automatic cell culture systems

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201104252A (en) * 2009-07-20 2011-02-01 Yaya Tech Co Ltd Cell detecting apparatus
CN103813094A (en) * 2012-11-06 2014-05-21 联发科技股份有限公司 Electronic device and related method capable of capturing images, and machine readable storage medium
CN105122037A (en) * 2013-06-07 2015-12-02 富士施乐株式会社 Image processing system, image processing device, program, storage medium, and image processing method
CN106896489A (en) * 2017-02-13 2017-06-27 清华大学 Frequency domain based on wavelength multiplexing pieces microscopic system and its method together

Also Published As

Publication number Publication date
CN116088158A (en) 2023-05-09
CN111656247A (en) 2020-09-11
WO2020010634A1 (en) 2020-01-16

Similar Documents

Publication Publication Date Title
AU2020200835B2 (en) System and method for reviewing and analyzing cytological specimens
JP6437947B2 (en) Fully automatic rapid microscope slide scanner
US10444486B2 (en) Systems and methods for detection of blank fields in digital microscopes
CN111932542B (en) Image identification method and device based on multiple focal lengths and storage medium
CN111656247B (en) Cell image processing system, cell image processing method, automatic film reading device and storage medium
CN112595496A (en) Method, device and equipment for detecting defects of near-eye display equipment and storage medium
Yang et al. Parasite detection in thick blood smears based on customized faster-RCNN on smartphones
WO2021148465A1 (en) Method for outputting a focused image through a microscope
US20200074628A1 (en) Image processing apparatus, imaging system, image processing method and computer readable recoding medium
WO2023031622A1 (en) System and method for identifying and counting biological species
CN112825622B (en) Sample image capturing method and sample image capturing apparatus
WO2020024227A1 (en) Cell analysis method, cell analysis device, and storage medium
CN209803001U (en) Chromosome scanning imaging system
CN203117515U (en) High-definition automatic identification comparison microscope
CN111951261A (en) Control method, computer device and control system for in-vitro biological sample examination process
CN112710821A (en) Cell analysis apparatus, method of analyzing cells, and computer-readable storage medium
Cruz et al. Automated urine microscopy using scale invariant feature transform
CN113916751B (en) Automatic detection system for whole cells of micro-vision image
JP2007017345A (en) Method and apparatus for automatically detecting observation target
Abate et al. Applied Computing and Informatics
JP2023088309A (en) Method for determining boundaries of z-stack of images of object, corresponding optical apparatus, and computer program therefor
TW202410056A (en) System and method for detecting specific cells based on image recognition
CN114858794A (en) Sample image photographing system, photographing method, and computer-readable storage medium
CN112903675A (en) Sample analyzer and cell image processing method for sample analyzer
CN114554107A (en) Sample image capturing apparatus, sample image capturing method, and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant