CN110850576A

CN110850576A - Microscope image scanning control method and device and computer storage medium

Info

Publication number: CN110850576A
Application number: CN201911036584.7A
Authority: CN
Inventors: 孙宝亮; 张志龙; 潘红九; 郭灵犀; 张鹏宇; 王振峰; 郑宇�; 商学谦; 薛凯; 纪祖赑
Original assignee: Beijing Institute of Near Space Vehicles System Engineering
Current assignee: Beijing Institute of Near Space Vehicles System Engineering
Priority date: 2019-10-29
Filing date: 2019-10-29
Publication date: 2020-02-28

Abstract

A method, a device and a computer storage medium for controlling image scanning of a microscope comprise the following steps: controlling an image acquisition device of a microscope to acquire an image of an object to be detected, and controlling a carrying device of the microscope to clamp the object to be detected to translate along a first direction by a preset first length; repeatedly translating until the preset first translation times are reached; controlling a carrying device of the microscope to clamp the object to be detected and rotate by a preset angle; controlling an image acquisition device of the microscope to acquire an image of an object to be detected, and controlling the object carrying device to clamp the object to be detected to translate along a second direction by a preset second length; and repeating the translation until the preset second translation times are reached. By adopting the scheme in the application, the multi-freedom-degree microscope image scanning can be realized.

Description

Microscope image scanning control method and device and computer storage medium

Technical Field

The present application relates to microscope technologies, and in particular, to a method and an apparatus for controlling image scanning of a microscope, and a computer storage medium.

Background

Fig. 1 shows a schematic structure of a microscope in the prior art, and as shown in the figure, the use method of the microscope at present generally comprises the following steps:

step 1, placing a slide specimen (a specimen made of a glass sheet) to be observed on an objective table, pressing the slide specimen by a pressing clamp, and enabling the specimen to be over against the center of a light through hole;

step 2, rotating the coarse focusing screw to slowly descend the lens cone until the objective lens approaches the slide specimen;

step 3, looking into the eyepiece, and simultaneously rotating the coarse focusing screw in the opposite direction to enable the lens cone to slowly rise until the object image is clearly seen; and then slightly rotating the fine focusing screw to make the observed object image clearer.

Problems existing in the prior art:

the specimen can only be viewed in the one-dimensional plane in which the glass sheet lies.

Disclosure of Invention

The embodiment of the application provides a microscope image scanning control method, a device and a computer storage medium, which are used for solving the technical problems.

According to a first aspect of the embodiments of the present application, there is provided a microscope image scanning control method, including the following steps:

step 1, controlling an image acquisition device of a microscope to acquire an image of an object to be detected, and controlling a carrying device of the microscope to clamp the object to be detected to translate along a first direction for a preset first length;

step 2, repeatedly executing the step 1 until the preset first translation times are reached;

step 3, controlling a carrying device of the microscope to clamp the object to be detected and rotate by a preset angle;

step 4, controlling an image acquisition device of the microscope to acquire an image of an object to be detected, and controlling the object carrying device to clamp the object to be detected to translate along a second direction by a preset second length;

step 5, repeatedly executing the step 4 until the preset second translation times are reached;

the first direction is a direction pointing from a current acquisition region of the object to be detected to a region to be acquired, and the second direction is a direction opposite to the first direction.

According to a second aspect of the embodiments of the present application, there is provided a microscope image scanning control device, including:

the first control module is used for controlling the image acquisition device of the microscope to acquire an image of an object to be detected;

the second control module is used for controlling the object carrying device of the microscope to clamp the object to be detected to translate along the first direction for each time for presetting a first length until the preset first translation times are reached;

the third control module is used for controlling the object carrying device of the microscope to clamp the object to be detected to rotate by a preset angle;

the fourth control module is used for controlling the object carrying device of the microscope to clamp the object to be detected to translate along the second direction for each time by a preset second length until the preset second translation times are reached;

According to a third aspect of the embodiments of the present application, there is provided a computer storage medium having a computer program stored thereon, the computer program, when executed by a processor, implementing the microscope image scanning control method as described above.

By adopting the microscope image scanning control method, the microscope image scanning control device and the computer storage medium provided in the embodiment of the application, after the current position image of the object to be detected is acquired each time, the objective table is controlled to perform translation or rotation in the first direction or the second direction on the object to be detected by a preset angle, and then image acquisition after the position is changed is performed, so that observation or image scanning of multiple dimensions of the object to be detected is realized, namely, the microscope image scanning with multiple degrees of freedom can be realized.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:

FIG. 1 shows a schematic of a prior art microscope;

fig. 2 is a schematic flowchart illustrating an implementation of a microscope image scanning control method according to an embodiment of the present application;

fig. 3 is another schematic flow chart illustrating an implementation of a microscope image scanning control method according to an embodiment of the present disclosure;

FIG. 4 is a schematic structural diagram of a microscope in accordance with one embodiment of the present application;

FIG. 5 is a schematic structural diagram of a loading device according to an embodiment of the present application;

FIG. 6 is a schematic structural diagram of an adjusting device according to a first embodiment of the present application;

FIG. 7 is a schematic structural diagram illustrating a clamping assembly according to a first embodiment of the present disclosure;

FIG. 8 is a schematic diagram of an optical device according to an embodiment of the present application;

fig. 9 is a schematic structural diagram illustrating a microscope image scanning control apparatus according to a second embodiment of the present application;

FIG. 10 is a schematic diagram illustrating the operation of the fourth embodiment of the present application before scanning the probe;

FIG. 11 is a schematic view showing an automatic scanning process of a microscope in the fourth embodiment of the present application;

FIG. 12 is a schematic view showing a scanning probe of a microscope in accordance with a fourth embodiment of the present invention;

1. a base; 2. a carrying device; 3. a drive device; 4. a light emitting device; 5. an optical device; 6. an image acquisition device;

21. an adjustment device; 22. a clamping assembly;

211. the objective table supports the guide rail frame; 212. an objective table reference seat; 213. a stage reference plate; 2141. a rotating electric machine; 2142. an X-direction linear motor; 2143. a Y-direction linear motor; 215. a rotating table; 216. a rotating table bracket; 217. a coupling; 218. an object stage;

221. clamping the substrate; 222. a first load bearing structure; 223. a second load bearing structure; 224. a first fixed structure; 225. a second fixed structure; 226. an object to be measured;

51. a disc-shaped bracket assembly; 52. a rotating shaft; 53. a lens barrel; 54. an element support.

Detailed Description

In view of the problems in the prior art, the embodiments of the present application provide a method and an apparatus for controlling microscope image scanning, and a computer storage medium, which can control an object stage to perform translation in a first direction or a second direction or rotate by a preset angle on an object to be detected after acquiring a current position image of the object to be detected each time, and then perform image acquisition after changing the position, thereby implementing multi-degree-of-freedom microscope image scanning.

The scheme in the embodiment of the application can be implemented by adopting various computer languages, such as object-oriented programming language Java and transliterated scripting language JavaScript.

In order to make the technical solutions and advantages of the embodiments of the present application more apparent, the following further detailed description of the exemplary embodiments of the present application with reference to the accompanying drawings makes it clear that the described embodiments are only a part of the embodiments of the present application, and are not exhaustive of all embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.

Example one

Fig. 2 is a schematic flowchart illustrating an implementation of a microscope image scanning control method according to an embodiment of the present application.

As shown in the figure, the image scanning control method for a microscope includes:

step 201, controlling an image acquisition device of a microscope to acquire an image of an object to be detected, and controlling a carrying device of the microscope to clamp the object to be detected to translate along a first direction for a preset first length;

step 202, repeatedly executing step 201 until a preset first translation number is reached;

step 203, controlling a carrying device of the microscope to clamp the object to be detected and rotate by a preset angle;

step 204, controlling an image acquisition device of the microscope to acquire an image of an object to be detected, and controlling the object carrying device to clamp the object to be detected to translate along a second direction by a preset second length;

step 205, repeatedly executing step 204 until a preset second translation time is reached;

In specific implementation, parameters or components such as a light source and an optical filter of a microscope can be set, an image acquisition device of the microscope is controlled to acquire an image of an object to be detected in a current scene, and a carrying device of the microscope is controlled to clamp the object to be detected and translate a small distance along a first direction; then collecting the image of the object to be measured, and controlling a carrying device of the microscope to clamp the object to be measured and translate the object to be measured for a short distance along the first direction; .., repeating the operations of capturing an image, translating once in a first direction, capturing an image, translating once in the first direction until a first number of translations is reached.

The preset first length may be a preset value, and the first number of times of translation may be a preset value, for example: the translation was 5 times, each movement was 3 mm.

Specifically, the preset first translation times may be determined according to the length of the object to be measured and the preset first length, for example: assuming that the object to be measured is 12mm, and each movement is set to be 3mm, the first translation number is 4. Alternatively, the preset first length may be determined according to the length of the object to be measured and the preset first translation number, for example: assuming that the object to be measured is 15mm, the first translation times are set to be 3 times, and then the first length of each translation is 5 mm.

After moving along the first direction for a preset first translation time, controlling the object carrying device to clamp the object to be detected to rotate for a preset angle, wherein the preset angle can be a preset numerical value, for example: and rotating the object to be measured by 30 degrees.

After the object to be detected is rotated, controlling the image acquisition device to acquire an image of the object to be detected, and then translating the object to be detected along a second direction by a preset distance of a second length; and controlling the image acquisition device to acquire the image of the object to be detected, then translating the object to be detected along the second direction by a preset second length distance.

The preset second length may be a preset value, and the second translation number may be a preset value, for example: the translation was 8 times, each time 2 mm.

Specifically, the preset second translation times may be determined according to the length of the object to be measured and the preset second length, for example: assuming that the object to be measured is 10mm, the second translation is 5 times if each movement is set to 2 mm. Alternatively, the preset first length may be determined according to the length of the object to be measured and the preset first translation number, for example: assuming that the object to be measured is 15mm, the first translation times are set to 5 times, and then the first length of each translation is 3 mm.

In a specific implementation, the first direction is a direction pointing to a to-be-acquired region from a current acquisition region of the to-be-detected object, that is, the first direction is a direction from the current acquisition region to an unrecovered region, and the second direction may be a direction opposite to the first direction.

In one embodiment, the first predetermined length and the second predetermined length are the same, and/or the first number of translations and the second number of translations are the same.

By adopting the microscope image scanning control method provided by the embodiment of the application, after the current position image of the object to be detected is acquired each time, the object stage is controlled to perform translation or rotation in the first direction or the second direction on the object to be detected by a preset angle, and then image acquisition after the position change is performed, so that observation or image scanning of multiple dimensions of the object to be detected is realized, namely, the microscope image scanning with multiple degrees of freedom can be realized.

In one embodiment, each time an image of the object under test is acquired, comprising:

focusing the microscope at the current position of the object to be detected;

collecting an image of the object to be detected under the current collecting channel;

switching acquisition channels, and respectively acquiring images of the object to be detected under different acquisition channels;

and the light source irradiating the object to be detected and the optical filter corresponding to the light source are different between the different acquisition channels.

In specific implementation, acquiring an image of an object to be measured each time may include: the method comprises the steps of firstly collecting a current scene, collecting after a first length is preset in a first translation mode, collecting after a first length is preset in a second translation mode, collecting after a second length is preset in a second translation mode, firstly collecting after rotation, collecting after a second length is preset in a first translation mode, collecting after a second length is preset in a second translation mode, and the like.

In specific implementation, when the image of the object to be detected is acquired each time, focusing operation can be performed first, then the acquisition channels of the object to be detected are switched, and the images of the object to be detected under different channels are acquired respectively;

specifically, switching the collection channel of the object to be measured, collecting the images of the object to be measured under different channels respectively may include: the method comprises the steps of firstly collecting an image of an object to be detected under a current channel, then switching a collecting channel, and collecting an image of the object to be detected under a next channel.

The switching acquisition channel can be used for switching a light source irradiating the object to be detected and an optical filter corresponding to the light source. The light sources irradiating the object to be measured under different channels are different, and the light filters corresponding to the light sources are also different. Specifically, the light source may be different in parameters such as color and wavelength of light, and the filter may be a set of filter lenses, for example: the red light source corresponds to a group of filter lens groups of the red light source, and the green light source corresponds to a group of filter lens groups of the green light source.

In one embodiment, the focusing the microscope at the current position of the object to be measured includes:

controlling a carrying device to carry an object to be detected to move the object to be detected along the y-axis direction within a predetermined image definition experience range, and acquiring an image of the object to be detected on each focal plane; the y-axis is perpendicular to the focal plane of the microscope;

determining an experience area image of the object to be detected, which is intercepted from the image of the object to be detected, according to the image of the object to be detected;

calculating a contrast value according to the experience area image of the object to be detected;

the microscope focus is placed at the position of the maximum contrast value.

In specific implementation, the predetermined image clarity experience range may be a distance range from the image acquisition device to the object to be measured or the carrying device. In particular, the image sharpness experience range may be one or more continuous values.

After the image of the object to be detected is obtained, the edge position of the object to be detected in the image of the object to be detected can be further determined, the experience area image of the object to be detected is determined according to the edge position, and then the experience area image is intercepted from the image of the object to be detected.

And after obtaining the experience area image of the object to be detected, calculating a contrast value according to the experience area image of the object to be detected.

In one embodiment, the calculating the contrast value according to the empirical region image of the object to be measured includes:

sequentially calculating the brightness difference between two adjacent pixels in the experience area image of the object to be detected, which is obtained at each focus;

and calculating the brightness difference value to obtain the contrast value of the experience area image of the object to be detected, which is obtained at each focus.

In a specific implementation, the calculating the luminance difference value may be performed according to the following formula:

wherein, m and n are the number of pixels in the transverse direction and the longitudinal direction of the experience area image; the X, Y is a coordinate value of a pixel point; and F is the contrast value of the empirical region image.

In one embodiment, the placing the microscope focus at the position focus where the contrast value is largest according to the position focus includes:

comparing the contrast value of the empirical region image of the object to be detected obtained at each focus point, and determining the position of the focus point corresponding to the image with the maximum contrast value;

and driving the image acquisition device to place the focus at the position of the focus with the maximum contrast value.

According to the embodiment of the application, only the image of the experience area of the object to be detected needs to be focused in a contrast mode, so that the calculation amount of focusing scanning and calculating the contrast value is greatly reduced, the focusing time is shortened, and the focusing of the object to be detected can be completed quickly.

According to the embodiment of the application, the object to be detected is controlled to move along the direction of the focusing axis (y axis) according to the predetermined image definition experience range, the image of the object to be detected is obtained and then the experience area image of the object to be detected is obtained through interception, the contrast value is calculated according to the experience area image, the microscope focus is placed on the position focus according to the position with the maximum contrast value, therefore, focusing can be completed only through few operations of the air pulling box, and the focusing efficiency is greatly improved.

In one embodiment, switching the acquisition channels to focus the microscope when acquiring the images of the object to be measured in different acquisition channels respectively includes:

determining the position of a microscope focusing axis when the microscope is focused under the acquisition channel before switching;

calculating the moving distance of the microscope focusing axis when the microscope is focused under the switched acquisition channel and determining the moving direction according to the position of the microscope focusing axis when the microscope is focused under the acquisition channel before switching and the experience value of the microscope focusing axis when the microscope is focused under the switched acquisition channel obtained by pre-calculation;

and controlling the focusing shaft of the microscope to move along the moving direction according to the moving distance.

In specific implementation, the image definition experience range may be different for different acquisition channels.

After the acquisition channels are switched, the distance to be moved under the current acquisition channel can be determined according to the position of the object carrying device when the previous acquisition channel is focused and the empirical value of the object carrying device of the microscope when the current acquisition channel is focused.

Wherein the controlling the movement of the stage device of the microscope in the moving direction may include:

when the difference value between the position of a microscope carrying device when the microscope is focused under the acquisition channel before switching and the experience value of the microscope carrying device when the microscope is focused under the acquisition channel after switching, which is calculated in advance, in the y-axis direction is more than zero, controlling the carrying device to move towards the direction close to the image acquisition device of the microscope;

when the difference value between the position of a microscope carrying device when the microscope is focused under the acquisition channel before switching and the experience value of the microscope carrying device when the microscope is focused under the acquisition channel after switching, which is obtained through pre-calculation, in the y-axis direction is less than zero, controlling the carrying device to move towards the direction far away from the image acquisition device of the microscope;

and when the difference value in the y-axis direction between the position of the microscope carrying device when the microscope is focused under the acquisition channel before switching and the experience value of the microscope carrying device when the microscope is focused under the acquisition channel after switching, which is obtained through pre-calculation, is equal to zero, controlling the moving distance of the carrying device to be zero.

In one embodiment, the empirical value of the microscope stage device in focus for each acquisition channel is calculated based on the wavelength of the excitation light and the refractive index of the objective lens for the acquisition channel.

In one embodiment, the object to be measured is a cylindrical object, the side surface of the object to be measured is a curved surface, and the image acquisition device is used for acquiring an image of the side surface of the object to be measured.

In specific implementation, the object to be measured is a cylindrical object, the side surface of the object to be measured is a curved surface with a certain curvature, and when the object to be measured with the curved surface structure is focused, if a focusing mode in the prior art is adopted, the curved surface structure influences the focusing process, so that a shot image is not clear; by adopting the focusing method provided by the embodiment of the application, the influence caused by the curved surface structure can be well filtered, the image of the experience area of the object to be detected is selected for focusing, the focusing process is fast, and the shot image is clear.

In one embodiment, the object to be tested is a medical probe, a stained cell is adsorbed on the medical probe, and a fluorescent substance is stained on the stained cell; the microscope is a fluorescence microscope.

The embodiment of the application provides a focusing method aiming at the problem that the image scanning by a microscope of a medical probe is difficult, and the probe is extremely fine and has a certain curvature, so that the scanning of stained cells on the probe by adopting the existing focusing method is very difficult.

In specific implementation, in order to perform medical diagnosis or observation, only the image of the stained cells needs to be scanned, and the carrier of the stained cells, that is, the medical probe, may be of a uniform specification, and only a new medical probe of the specification needs to be used to extract the stained cells each time the extraction of the stained cells is performed, so that the medical probe can have a clear experience range and an experience area of the image.

In a specific implementation, for better medical diagnosis or observation, the stained cells adsorbed on the medical probe may be stained with a fluorescent substance, and the microscope may be a fluorescence microscope, and the fluorescence microscope may emit fluorescence to excite the fluorescent substance stained by the stained cells, so that images of the stained cells may be clearly presented.

Fig. 3 is another schematic flow chart illustrating an implementation of a microscope image scanning control method according to an embodiment of the present application.

As shown, in one embodiment, the method further comprises:

and step 206, repeatedly executing the step 203 until the preset times or the preset total rotation angle is reached.

In specific implementation, the preset number of rotations can be determined according to the total circumferential rotation angle (i.e. the preset total rotation angle) to be scanned of the object to be detected and the preset angle of each rotation, for example: assuming that the total circumferential rotation angle to be scanned by the object to be measured is 360 degrees, the preset angle of each rotation is set to be 30 degrees, and the preset times are 12 times; alternatively, the preset angle of each rotation may be determined according to the total circumferential rotation angle (i.e. the preset total rotation angle) to be scanned of the object to be detected and the preset number of rotations, for example: assuming that the total circumferential rotation angle to be scanned by the object to be measured is 180 °, the preset number of times is set to 3, and the preset angle of each rotation is 60 °.

Fig. 4 shows a schematic structural diagram of a microscope in the first embodiment of the present application.

As shown, in one embodiment, the microscope comprises: the device comprises a base 1, an object carrying device 2 arranged on the base 1, a driving device 3 for driving the object carrying device 2 to move, a light emitting device 4, an optical device 5 and an image acquisition device 6; the object carrying device 2 is used for clamping the object to be tested and is positioned on the object carrying side of the optical device 5; the light-emitting device 4 is positioned at the light source side of the optical device 5, corresponds to the light source interface of the optical device 5, and is used for mapping the image of the object to be measured onto the image acquisition device 6; the optical device 5 is internally provided with a lens and an optical filter and is used for changing the light transmission direction and carrying out reflection, projection, filtering and other treatments on the light; the image acquisition device 6 is located on the imaging side of the optical device 5 and corresponds to the image acquisition interface of the optical device 5.

The base 1 is provided with a connecting line interface which can comprise a power interface and a data interface. The power supply interface is connected with each component and used for supplying power to each component through a power supply; the data interface is connected with the controller and used for controlling the operation of each part and transmitting the image of the object to be measured.

Fig. 5 shows a schematic structural diagram of a loading device in an embodiment of the present application.

As shown, the carrier device 2 includes: an adjustment device 21 and a clamping assembly 22. Wherein, adjusting device 21 sets up on base 1, and centre gripping subassembly 22 detachable sets up on adjusting device 21 for the centre gripping object to be measured.

Fig. 6 shows a schematic structural diagram of an adjusting device in a first embodiment of the present application.

As shown, the adjusting device 21 includes a stage support rail frame 211, a stage reference base 212, a stage reference plate 213, a linear motor, a rotary motor 2141, a rotary table 215, and a rotary table support 216. Wherein, linear electric motor includes: an X-direction linear motor 2142 and a Y-direction linear motor 2143.

In one embodiment, the adjustment device 21 further comprises a stage 218 fixedly mounted on the top surface of the stage reference plate 213, and the stage 218 is used for fixedly mounting the clamping assembly 22. The object stage 218 sets up the both ends at object stage reference plate 213 with revolving stage 215 relatively, object stage 218 can be used for directly placing the object to be measured, also can be used for fixed centre gripping subassembly 22, can adjust the height of the object to be measured through object stage 218, in addition, can also be through changing the centre gripping subassembly 22 of object stage 218 in order to deal with different structures of different structures, avoid the defect that can only use specific centre gripping subassembly because of the installation fixed mode singleness of object stage reference plate 213, thereby can improve adjusting device's application scope and availability factor.

The stage reference base 212 is mounted on the top of the stage support rail frame 211 to be movable in the horizontal direction. A stage support rail holder 211 is provided at the bottom of the stage adjusting device 21, and the stage support rail holder 211 can be attached to the base 1 as a base of the stage adjusting device. The stage reference base 212 is mounted on the top of the stage support rail frame 211, and the stage reference base 212 is driven by a Y-direction linear motor 2143 to reciprocate in the second direction B with respect to the stage support rail frame 211. In a specific mounting structure, the primary coil of the Y-direction linear motor 2143 may be fixedly attached to the stage support rail bracket 211, and the secondary coil of the Y-direction linear motor 2143 may be fixedly attached to the stage reference base 212.

The stage reference plate 213 is mounted on the top of the stage reference base 212 so as to be movable in the horizontal direction. A stage reference plate 213 is mounted on top of the stage reference base 212, and the stage reference plate 213 is used to mount a stage 218, the clamping assembly 22, a turntable support 216, and a turntable 215. The stage reference plate 213 can reciprocate in the first direction a with respect to the stage reference base 212 by driving the X-direction linear motor 2142.

The turntable support 216 is fixedly attached to the top surface of the stage reference plate 213, the turntable support 216 is fixedly attached to one end of the stage reference plate 213, and the turntable support 216 supports the turntable 215.

The rotating platform 215 can be rotatably mounted on the rotating platform bracket 216 around the axis line thereof, an output shaft is arranged on the surface of one side of the rotating platform 215 departing from the rotating platform bracket 216, and the clamping assembly can be driven to rotate by the rotation of the output shaft so as to realize the angle adjustment of the observed object.

The linear motor is in transmission connection with both the object table reference seat 212 and the object table reference flat plate 213 and is used for driving the object table reference seat 212 and the object table reference flat plate 213 to move. The X-direction linear motor 2142 is fixedly mounted to the stage reference base 212 and configured to drive the stage reference plate 213 to move along the first direction a, and the Y-direction linear motor 2143 is fixedly mounted to the stage support rail bracket 211 and configured to drive the stage reference base 212 to move along the second direction B, where the second direction B is perpendicular to the first direction a.

The rotating motor 2141 is in transmission connection with the rotating platform 215 and is used for driving the rotating platform 215 to rotate. The rotating motor 2141 is installed on one side of the rotating platform support 216, and the rotating motor 2141 may be directly and fixedly installed on the rotating platform support 216, or may be directly installed on the stage reference plate 213, and drives the rotating platform 215 to rotate through a transmission connection with the rotating platform 215.

The rotary table 215 is provided with an output shaft extending in the horizontal direction, the rotary table 215 is provided with an output shaft protruding on one side surface of the rotary table holder 216, the output shaft extends in the horizontal direction, and the extending direction of the axis line of the output shaft is the same as the first direction a.

Above-mentioned adjusting device 21 can be with centre gripping subassembly 22 fixed mounting on the output shaft of revolving stage 215, adjust the observation angle of observed object through the rotation of output shaft, simultaneously, can also move in the horizontal direction through linear electric motor drive objective table reference plate 213 and objective table reference seat 212 in order to adjust the position of the object of awaiting measuring on the horizontal direction to realize the observation and the scanning to the multi-angle of the object of awaiting measuring through rotating electrical machines 2141 and linear electric motor, make the object of awaiting measuring obtain omnidirectional observation and scanning.

To facilitate the rotational connection between the rotating platform 215 and the clamping assembly 22, the stage adjustment device further comprises a coupling 217, the coupling 217 being fixedly mounted to an end of an output shaft of the rotating platform 215 for coupling with the clamping assembly 22 to transmit a rotational torque to the clamping assembly 22.

Because the coupling 217 is arranged on the output shaft of the rotating platform 215, the connecting shaft of the clamping assembly can be conveniently and quickly mounted on the output shaft of the rotating platform 215, and the connecting shaft of the clamping assembly is coaxial with the output shaft, the observation angle of an observed object can be directly controlled through the rotating motor 2141, so that the observation of a user is facilitated, and the working efficiency is improved.

Fig. 7 shows a schematic structural diagram of a clamping assembly in a first embodiment of the present application.

As shown, the clamping assembly 22 includes: a clamping base 221, a first carrier structure 222, a second carrier structure 223, a first fixing structure 224 and a second fixing structure 225. The first bearing structure 222 and the second bearing structure 223 are respectively disposed at two ends of the clamping base 221 along a length direction, the length direction is the same as the length direction of the object 226 to be measured, and the length direction of the object 226 to be measured may also be referred to as an axial direction. The first bearing structure 222 and the second bearing structure 223 are respectively located below two ends of the object to be tested 226, and are used for supporting the two ends of the object to be tested 226, and the supporting force is perpendicular to the axial direction of the probe.

A first fixing structure 224 is disposed on the first carrying structure 222 for fixing one end of an object 226 to be measured. A second fixing structure 225 is disposed on the second carrying structure 223 for fixing the other end of the object to be measured 226. The pressing force applied by the first fixing structure 224 and the second fixing structure 225 to the object 226 to be measured is perpendicular to the axial direction of the object to be measured, and the object 226 to be measured is fixed.

In the above solution, the first bearing structure 222 and the second bearing structure 223 are respectively disposed at two ends of the clamping base 221, for supporting two ends of the object 226, a first fixing structure 224 is disposed on the first carrying structure 222 to fix one end of the object 226, a second fixing structure 225 is disposed on the second carrying structure 223 to fix the other end of the object 226, since the force applied by the first carrying structure 222 and the first fixing structure 224 to the object 226 to be measured is perpendicular to the axial direction of the object 226 to be measured, the force applied by the second carrying structure 223 and the second fixing structure 225 to the object 226 to be measured is also perpendicular to the axial direction of the object 226 to be measured, therefore, the torsion force or the axial tension force cannot be applied to the object to be measured 226, and the problem that the object to be measured is easily subjected to torsion deformation due to the fact that the torsion force and the axial tension force are applied to the object to be measured in a mode of clamping two ends in the traditional scheme is solved.

Fig. 8 is a schematic structural diagram of an optical device according to an embodiment of the present application.

As shown, the optical device 5 includes: a first light shielding housing, a disc-shaped holder assembly 51 disposed within the first light shielding housing, a rotary shaft 52, a lens barrel 53, and a plurality of element holders 54. Wherein the content of the first and second substances,

the first shading shell is used for packaging internal components, and light of the external environment is prevented from interfering with internal optical elements.

The rotating shaft 52 is inserted through the center of the disc-shaped bracket assembly 51, and both ends of the rotating shaft extend out of the first shading shell. The disc-shaped holder assembly 51 is rotatably supported by a rotary shaft 52, thereby achieving rotational adjustment and selection of optical elements mounted on an element holder 54 of the disc-shaped holder assembly 51.

A plurality of component supports 54 are mounted on the circumferential direction of the disc-shaped support assembly 51, and the component supports 54 may be uniformly distributed or randomly distributed on the circumferential direction of the disc-shaped support assembly 51.

The element holder 54 is used for mounting an optical element such as a filter, and is provided with a cavity for mounting the optical element therein, and a light inlet and a light outlet communicating with the cavity, so that light passes through the light inlet and then exits from the light outlet through the optical element.

The first shading shell is provided with a first light hole corresponding to the position of the light inlet hole and a second light hole corresponding to the position of the light outlet hole, and the central axis of the first light hole is perpendicular to the central axis of the second light hole. By adjusting the rotating shaft 52, the first light-transmitting hole is opposite to the light-entering hole of the component holder 54 and the second light-transmitting hole is opposite to the light-exiting hole on the side of the component holder 54, thereby forming an optical path.

The lens barrel 53 is fixedly mounted on the inner side surface of the shading shell and is opposite to the second light-transmitting hole, and the lens barrel 53 is used for mounting light-transmitting elements such as lenses and objective lenses.

As shown in fig. 1, the light emitting device 4 may include: the second light-shading shell and the light source are positioned in the second light-shading shell. One side of the second shading shell facing the optical device 5 is provided with a light hole, and the light source emits light towards the light hole.

The second shading shell can be internally provided with a plurality of light sources, and the characteristics of the light emitted by each light source, such as wavelength, intensity and the like, have certain differences. A plurality of light sources may be disposed on a rotating bracket, which is driven to rotate by a rotating motor to select one of the light sources to emit light toward the optical device 5. The structure of the rotating bracket can refer to the implementation of the disc-shaped bracket assembly 51 described above.

Example two

Based on the same inventive concept, the embodiment of the present application provides a microscope image scanning control device, and the principle of the device for solving the technical problem is similar to that of a microscope image scanning control method, and repeated parts are not repeated.

Fig. 9 is a schematic structural diagram of a microscope image scanning control device according to a second embodiment of the present application.

As shown in the figure, the image scanning control device for a microscope includes:

the first control module 901 is used for controlling an image acquisition device of the microscope to acquire an image of an object to be detected;

the second control module 902 is configured to control the object carrying device of the microscope to clamp the object to be detected to translate along the first direction for each time by a preset first length until a preset first number of translations is reached;

a third control module 903, configured to control the object carrying device of the microscope to clamp the object to be detected and rotate by a preset angle;

a fourth control module 904, configured to control the object carrying device of the microscope to clamp the object to be detected to translate along the second direction for each time by a preset second length until a preset second number of translations is reached;

By adopting the microscope image scanning control device provided in the embodiment of the application, after the current position image of the object to be detected is acquired at each time, the object stage is controlled to translate or rotate a preset angle in the first direction or the second direction on the object to be detected, and then the image acquisition after the position change is performed, so that the observation or image scanning of multiple dimensions of the object to be detected is realized, namely the microscope image scanning with multiple degrees of freedom can be realized.

In one embodiment, the first control module includes:

the focusing unit is used for focusing in the current scene;

the channel switching unit is used for switching the acquisition channel of the object to be detected;

the acquisition unit is used for controlling an image acquisition device of the microscope to respectively acquire images of the object to be detected under different channels;

the switching of the acquisition channel of the object to be detected comprises; and switching the light source color irradiating the object to be detected and the optical filter corresponding to the light source color.

In one embodiment, the focusing unit includes:

the focusing axis position determining subunit is used for determining the position of the focusing axis when the microscope is focused under the previous acquisition channel;

a moving distance determining subunit, configured to control, according to a pre-calculated empirical value of the focusing axis corresponding to focusing in the current acquisition channel, the focusing axis to move by a distance equal to the empirical value in a direction corresponding to the empirical value,

in one embodiment, the empirical value of focusing corresponding to focusing in each acquisition channel is calculated according to the wavelength of the excitation light in the acquisition channel and the refractive index of the objective lens.

In one embodiment, the object to be measured is a cylindrical object.

In one embodiment, the third control module is configured to control the object carrying device of the microscope to clamp the object to be detected to rotate by a preset angle each time until the object to be detected rotates by a preset number of times or a preset total rotation angle.

EXAMPLE III

Based on the same inventive concept, embodiments of the present application further provide a computer storage medium, which is described below.

The computer storage medium has a computer program stored thereon, and the computer program, when executed by a processor, implements the steps of the microscope image scanning control method according to the first embodiment.

By adopting the computer storage medium provided in the embodiment of the application, after the current position image of the object to be detected is acquired at each time, the object stage is controlled to perform translation or rotation in the first direction or the second direction on the object to be detected by a preset angle, and then image acquisition after the position change is performed, so that observation or image scanning of multiple dimensions of the object to be detected is realized, namely, the microscope image scanning with multiple degrees of freedom can be realized.

Example four

In order to facilitate the implementation of the present application, the embodiments of the present application are described with a specific example.

The embodiment of the application provides a fluorescence microscope and an image scanning process for detecting a medical probe by using the fluorescence microscope.

In the embodiment of the application, the medical probe can be dyed with fluorescent materials and is clamped by the object stage, exciting light emitted by the light emitting device 4 passes through the light source interface and enters the optical device 5, the optical device 5 reflects the exciting light and emits the exciting light to the medical probe, the fluorescent materials on the medical probe emit fluorescent light after receiving the exciting light, the fluorescent light is mapped to the image acquisition device 6 through the optical device 5, the image acquisition device 6 acquires images of the medical probe, and the cell characteristics on the medical probe can be acquired after image processing and analysis.

Prior to the observation, the medical probe is loaded onto the clamping assembly 22, and the clamping assembly 22 is loaded onto the adjustment device 21. The adjusting device 21 drives the clamping assembly 22 to move or drives the clamping assembly 22 to rotate under the control of the controller, so that the position and the angle of the medical probe can be changed, and comprehensive observation can be realized.

The object carrying device of the microscope clamps the medical probe to rotate along the rotating shaft so as to realize axial scanning of the probe sample; the x-axis motor controls the carrying device to move in the x-axis direction so as to realize transverse scanning of the probe sample; and the y-axis motor controls the carrying device to move in the y-axis direction so as to realize the focusing of the probe sample in the y-axis direction.

In the embodiment of the application, the lens field of the microscope is large enough, so that the probe sample does not need to be adjusted or moved on the z-axis.

Fig. 10 is a schematic diagram illustrating an operation process before scanning the probe in the fourth embodiment of the present application.

As shown, the operation process is as follows:

the microscope is powered on, and the upper computer controls the system to complete self-inspection;

if the self-checking fails, recording a fault code and returning, and after the self-checking succeeds, returning the microscope to a physical zero position, including an optical filter, a light source, a carrying device and the like, wherein in the specific implementation, whether the motor has zero drift can be detected every zero returning 1 time;

after the system returns to zero, the system finishes retreating to the cabin door, and specifically, the system can retreat the y axis first and then retreat the x axis;

the upper computer detects whether the probe is installed or not, and can execute the operation of entering the cabin after detecting that the probe sample is loaded; if the probe is not loaded, the clamping assembly of the loading device is controlled to move to the cabin door, and the x axis and the y axis move back to the zero point for needle loading;

when the vehicle enters the cabin, the vehicle can move to the left along the x axis, then move to the zero point of the objective lens along the y axis; after the vehicle enters the cabin in place, automatic focusing is started; when in specific focusing, the y axis can be moved under the condition that the x axis is not moved to carry out contrast focusing.

When the focus is clear, automatic scanning can be performed according to a scanning scheme for setting, for example: the number of transverse translations and step length, the number of axial rotations, parameters of each channel, and the like, wherein the parameters of the channels can include camera gain and exposure time.

Fig. 11 shows a schematic view of an automatic scanning process of a microscope in the fourth embodiment of the present application.

Fig. 12 is a schematic view showing a process of scanning a probe with a microscope in the fourth embodiment of the present application.

As shown, the scanning process is as follows:

and step A, finishing automatic focusing in the current scene.

B, switching acquisition channels of the probe samples in sequence, and acquiring sample images under each channel; specifically, switching the collection channel of the sample to switch the light source and the corresponding optical filter, for example: a red light source and red filter channel, a yellow light source and yellow filter channel, etc.

And C, the probe is clamped by the carrying device to translate one unit from the current visual field area along the direction (forward direction for short) of the area to be acquired of the probe according to the configuration of a user.

And D, repeatedly executing the step A, B, C for M times.

And E, rotating the probe by 360/N DEG. I.e. one rotation after M lateral or forward movements.

And F, automatic focusing.

And G, switching acquisition channels in sequence to acquire probe images.

And H, clamping the probe by the carrying device and reversely translating by one unit according to the configuration of the user.

And step I, repeatedly executing the step F, G, H for M times.

And step J, repeatedly executing the step E, F, G, H for N times.

And step K, completing scanning, and performing operations such as image recognition, data storage and the like.

The method and the device for the automatic focusing are used for carrying out automatic focusing under each channel, the automatic focusing process comprises the step of obtaining a group of empirical values through calculation according to the wavelength of excitation light of each channel and the refractive index of an objective lens, and the empirical values are the moving distance of a focusing axis. Namely, the current position of the focusing shaft under the focusing channel is taken as a reference, when the focusing shaft is switched to different channels, the focusing shaft moves by an empirical value, and high-definition imaging can be realized under the channel without focusing.

The embodiment of the application provides a microscope scanning scheme with 5 degrees of freedom aiming at the scanning requirements of the medical probe such as whole needle scanning, optical filter switching and the like, saves the moving shaft in the lifting direction, and can complete the automatic scanning control of the medical probe. Specifically, when the length of the functional region of the probe (the region to which stained cells are attached) is 26mm, the scanning time is not more than 31 min.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims

1. A method for controlling image scanning of a microscope, comprising:

2. The method of claim 1, wherein each time an image of the object to be measured is acquired, comprising:

focusing the microscope at the current position of the object to be detected;

3. The method of claim 2, wherein focusing the microscope at the current position of the object to be measured comprises:

the microscope focus is placed at the position of the maximum contrast value.

4. The method of claim 2, wherein switching the acquisition channels to focus the microscope while acquiring the images of the object to be measured in different acquisition channels respectively comprises:

determining the position of a microscope carrying device when the microscope is focused under the acquisition channel before switching;

calculating the moving distance of the microscope carrying device when the microscope is focused under the switched acquisition channel and determining the moving direction according to the position of the microscope carrying device when the microscope is focused under the acquisition channel before switching and the experience value of the microscope carrying device when the microscope is focused under the switched acquisition channel which is obtained by pre-calculation;

and controlling the object carrying device of the microscope to move along the moving direction according to the moving distance.

5. The method according to claim 4, wherein the empirical value of the microscope stage device in focus for each acquisition channel is calculated from the wavelength of the excitation light and the refractive index of the objective lens for the acquisition channel.

6. The method according to claim 1, wherein the object to be measured is a cylindrical object, the side surface of the object to be measured is a curved surface, and the image acquisition device is used for acquiring an image of the side surface of the object to be measured.

7. The method according to claim 1, wherein the object to be tested is a medical probe, a stained cell is adsorbed on the medical probe, and a fluorescent substance is stained on the stained cell; the microscope is a fluorescence microscope.

8. The method of claim 1, further comprising:

and 6, repeatedly executing the step 3 until the preset times or the preset total rotation angle are reached.

9. The method of claim 1, wherein the microscope comprises: the device comprises a base, an object carrying device arranged on the base, a driving device used for driving the object carrying device to move, a light emitting device, an optical device and an image acquisition device; the object carrying device is used for clamping the object to be detected and is positioned on the object carrying side of the optical device; the light-emitting device is positioned at the light source side of the optical device, corresponds to the light source interface of the optical device and is used for mapping the image of the object to be detected onto the image acquisition device; a lens and an optical filter are arranged in the optical device; the image acquisition device is positioned on the imaging side of the optical device and corresponds to the image acquisition interface of the optical device.

10. A microscope image scanning control device, comprising:

11. A computer storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 8.