CN107622491B - Optical fiber bundle image analysis method and device - Google Patents

Optical fiber bundle image analysis method and device Download PDF

Info

Publication number
CN107622491B
CN107622491B CN201710958665.7A CN201710958665A CN107622491B CN 107622491 B CN107622491 B CN 107622491B CN 201710958665 A CN201710958665 A CN 201710958665A CN 107622491 B CN107622491 B CN 107622491B
Authority
CN
China
Prior art keywords
pixel
image
fiber bundle
optical fiber
bundle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710958665.7A
Other languages
Chinese (zh)
Other versions
CN107622491A (en
Inventor
邵金华
段后利
孙锦
Original Assignee
Suzhou Weijing Medical Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Weijing Medical Technology Co ltd filed Critical Suzhou Weijing Medical Technology Co ltd
Priority to CN201710958665.7A priority Critical patent/CN107622491B/en
Publication of CN107622491A publication Critical patent/CN107622491A/en
Priority to PCT/CN2018/110252 priority patent/WO2019076267A1/en
Application granted granted Critical
Publication of CN107622491B publication Critical patent/CN107622491B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/136—Segmentation; Edge detection involving thresholding
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods

Abstract

The embodiment of the invention provides a method and a device for analyzing an image of a fiber bundle. The method comprises the following steps: collecting a reference image by using an optical fiber bundle; determining a reference pixel in the reference image, wherein the pixel value of the reference pixel is higher than the pixel values of its surrounding pixels; and determining the pixel position of the corresponding optical fiber center in the optical fiber bundle image acquired by using the same optical fiber bundle according to the pixel position of the reference pixel. The method and the device not only can accurately analyze the optical fiber bundle image, but also have small calculation amount and short time consumption in the whole calculation process.

Description

Optical fiber bundle image analysis method and device
Technical Field
The invention relates to the field of medical image processing, in particular to a method and a device for analyzing an optical fiber bundle image.
Background
With the progress of society and the development of technology, more and more electronic imaging apparatuses are applied to the medical field. Therefore, higher and higher requirements are also put on the accuracy and speed of the post-processing of medical images.
For example, the fiber-optic microscope can realize the chromatography inspection of biological tissues, not only can detect the tumor lesion tendency of the biological tissues in advance, but also avoids the pain of clinical patients caused by puncture operation. Fiber optic microscopes have broad market prospects in clinical patient examination, screening, and medical and biological research.
Because the data volume of the fiber bundle image is very large, the existing analysis method of the fiber bundle image is extremely computationally expensive. If the fiber bundle image is compressed first and then analyzed and processed in order to reduce the calculation amount, the inaccurate result of the analysis is generated.
Disclosure of Invention
The present invention has been made in view of the above problems. The invention provides a method and a device for analyzing an optical fiber bundle image,
according to an aspect of the present invention, there is provided a fiber bundle image analysis method including:
collecting a reference image by using an optical fiber bundle;
determining a reference pixel in the reference image, wherein the pixel value of the reference pixel is higher than the pixel values of its surrounding pixels; and
and determining the pixel position of the corresponding optical fiber center in the optical fiber bundle image acquired by using the same optical fiber bundle according to the pixel position of the reference pixel.
Illustratively, the determining a reference pixel in the reference image comprises:
performing image segmentation on the reference image to determine a fiber bundle imaging region in the reference image; and
determining the reference pixel in the fiber bundle imaging region.
Illustratively, the determining the reference pixel in the fiber bundle imaging region comprises:
processing the imaging area of the optical fiber bundle by using an area maximum value method; and
determining a pixel whose pixel value is a regional maximum as the reference pixel.
Illustratively, the acquiring a reference image using a fiber optic bundle includes:
sampling a homogeneous fluorescence sample with the fiber optic bundle to acquire the reference image.
According to another aspect of the present invention, there is also provided a fiber bundle image analyzing apparatus including:
the image acquisition equipment is used for acquiring a reference image by using the optical fiber bundle;
a memory for storing a program;
a processor for running the program;
wherein the program, when executed in the processor, is configured to perform the steps of:
step S1, determining a reference pixel in the reference image, wherein the pixel value of the reference pixel is higher than the pixel values of its peripheral pixels; and
and step S2, determining the pixel position of the corresponding optical fiber center in the optical fiber bundle image collected by the same optical fiber bundle according to the pixel position of the reference pixel.
For example, when the step S1 is executed, the following steps are specifically executed:
step S11, performing image segmentation on the reference image to determine a fiber bundle imaging area in the reference image; and
step S12, determining the reference pixel in the fiber bundle imaging area.
For example, when the step S12 is executed, the following steps are specifically executed:
processing the imaging area of the optical fiber bundle by using an area maximum value method; and
determining a pixel whose pixel value is a regional maximum as the reference pixel.
Illustratively, the image acquisition device acquires the reference image by sampling a uniform fluorescence sample with the fiber optic bundle.
The optical fiber bundle image analysis method and the optical fiber bundle image analysis device not only can accurately analyze the optical fiber bundle image, but also have small calculated amount and short consumed time in the whole calculation process.
Drawings
The above and other objects, features and advantages of the present invention will become more apparent by describing in more detail embodiments of the present invention with reference to the attached drawings. The accompanying drawings are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings, the same reference numbers generally represent the same or similar parts or steps.
FIG. 1 schematically illustrates a portion of an image of an existing fiber optic bundle;
FIG. 2 shows a schematic flow diagram of a fiber bundle image processing method according to one embodiment of the present invention;
FIG. 3 illustrates a partially enlarged schematic view of a reconstructed image of the fiber bundle image of FIG. 1 according to one embodiment of the invention;
FIG. 4 shows a schematic flow diagram of a fiber optic bundle image analysis method in accordance with a specific embodiment of the present invention;
FIG. 5 illustrates a reference image obtained by sampling a homogeneous fluorescence sample according to one embodiment of the present invention;
FIG. 6 shows a partially enlarged schematic view of a reference image according to one embodiment of the invention;
FIG. 7 shows a partially enlarged schematic view of a reference image identifying pixels therein corresponding to the center of the fiber according to one embodiment of the invention;
FIG. 8 shows a schematic diagram of a fiber optic bundle image identifying pixels therein corresponding to the centers of the optical fibers, according to one embodiment of the present invention;
FIG. 9 shows a schematic flow chart of the reconstruction step according to one embodiment of the present invention;
FIG. 10 shows a partially enlarged schematic view of a sample image triangulated within Delaunay according to one embodiment of the present invention;
11A and 11B illustrate a reconstructed image and another image, respectively, to be registered according to an embodiment of the invention; and
fig. 11C shows a schematic diagram of the result of non-rigid body registration of the two images shown in fig. 11A and 11B.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, exemplary embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. It is to be understood that the described embodiments are merely a subset of embodiments of the invention and not all embodiments of the invention, with the understanding that the invention is not limited to the example embodiments described herein. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the invention described herein without inventive step, shall fall within the scope of protection of the invention.
Fig. 1 exemplarily shows a part of an image of an existing fiber bundle. As shown in fig. 1, the conventional bundle fiber image has noise in a honeycomb shape, and fails to represent a target region of a biological tissue well. Although some reconstruction techniques currently exist for fiber bundle images, they are generally computationally intensive and time consuming. FIG. 2 illustrates a fiber optic bundle image processing method 200 according to one embodiment of the present invention. The fiber bundle image processing method 200 may be used to reconstruct the original fiber bundle image to more optimally represent a target region of biological tissue.
As shown in fig. 2, in step S210, pixel information of a position corresponding to the center of the optical fiber in the sample image is determined.
The sample image is a fiber bundle image acquired using a fiber bundle. The bundle includes a large number of fibers, for example up to thirty thousand. The arrangement of the fibers in the bundle is irregular. Each fiber may serve as an optical path that may transmit information in a target region of biological tissue to generate a fiber bundle image in an imaging device. The size of the bundle image obtained from the same bundle is uniform, i.e. its resolution, width and height are the same. In some examples, the imaging area of the fiber bundle in the fiber bundle image may be, for example, a circular area. Since the optical fiber bundle includes a plurality of optical fibers, honeycomb noise will inevitably occur in the optical fiber bundle image, as shown in the optical fiber bundle image of fig. 1. Each cell therein corresponds to approximately one optical fiber. The existence of the cellular noise brings great trouble to a user for observing a target area of biological tissues by using the optical fiber bundle image, and the user experience is seriously influenced.
A cell in the bundle image typically includes a plurality of pixels. In other words, each fiber in the fiber bundle may correspond to a plurality of pixels, e.g., about twenty, in the fiber bundle image. One pixel exists among the plurality of pixels, which corresponds one-to-one to the center of the optical fiber. If the far end or the near end of the optical fiber bundle does not change in the process of shooting different optical fiber bundle images by using the same optical fiber bundle, the corresponding relation between the pixels in the optical fiber bundle images and the optical fibers in the optical fiber bundle is kept unchanged. Therefore, the position of the pixel corresponding to the center of each optical fiber in the optical fiber bundle image is kept unchanged. In addition, the pixel value corresponding to the center of the optical fiber can reflect the real surface of the target area of the biological tissue ideally.
In this step S210, a pixel corresponding to the center of each optical fiber in the optical fiber bundle in the sample image is determined and pixel information of the pixel is extracted. Optionally, the determined pixel information comprises a position of the pixel and a pixel value. The position of the pixels may be represented by the row and column values of the pixels in the sample image. In particular, the positions of the pixels may be represented by a one-dimensional array. One element in the array is a value representing the position of one pixel. The position Px of the pixel x can be expressed by the following formula,
px is the number of rows where pixel x is located x the width of the sample image + the number of columns where pixel x is located.
The position Px of the pixel x is counted one by one from the pixels in the first row and the first column of the bundle image, and the pixel x is the several pixels. By querying the sample image for the location of a pixel, the pixel value of that pixel can be obtained.
In step S220, the pixel information determined in step S210 is corrected.
The determined pixel information may include the location and pixel value of the pixel corresponding to the fiber center, as described in step S210. In step S220, the pixel values of only the portion of pixels corresponding to the center position of the optical fiber in the sample image are corrected to reflect the target area more realistically.
In step S230, the sample image is reconstructed based on the pixel information corrected in step S220 to obtain a reconstructed image. In step S220, the pixel values of only the portion of the pixels in the sample image corresponding to the fiber center are adjusted. Based on the adjustment result, the pixel values of other pixels in the sample image, i.e., pixels that do not correspond to the center position of the optical fiber, are adjusted, thereby completing the reconstruction of the sample image. FIG. 3 illustrates a partially enlarged schematic view of a reconstructed image of the fiber bundle image shown in FIG. 1 according to one embodiment of the invention.
From the perspective of the image, as shown in fig. 3, the honeycomb-shaped noise in the original sample image is eliminated from the image reconstructed by the above image processing operation, and in addition, the brightness of the whole reconstructed image is uniform, so that the problem that the edge is dark but the middle is bright is avoided. From the perspective of image processing, the whole processing procedure is small in calculation amount and short in time consumption.
According to one embodiment of the invention, a method for analyzing an image of a fiber bundle is provided. The analysis method can be used for more accurately determining the pixel information of the position corresponding to the center of the optical fiber in the optical fiber bundle image. As described above, in the case where the distal end or the proximal end of the optical fiber bundle is not changed during the process of capturing images of different optical fiber bundles using the same optical fiber bundle, the correspondence between the pixels in the captured image of the optical fiber bundle and the optical fibers in the optical fiber bundle is maintained. Thus, from this perspective, one bundle image can be used to analyze all other bundle images that it takes with the same bundle. In addition, in the practical application scene of the optical fiber bundle image, the pixel corresponding to the position of the center of the optical fiber can represent the real aspect of the target area of the biological tissue. Therefore, it is very important to accurately analyze the pixels corresponding to the center of the optical fiber in the optical fiber bundle image for subsequent image processing. FIG. 4 shows a schematic flow diagram of a fiber bundle image analysis method 400 in accordance with a specific embodiment of the present invention.
In step S410, a fiber bundle image is acquired using the fiber bundle as a reference image. The analysis result of the reference image can be applied to all other fiber bundle images taken with the same fiber bundle.
Optionally, the reference image is acquired by sampling the uniformly illuminated sample with a fiber optic bundle. Theoretically, the reference image should be a uniform-pixel-value, uniform-brightness fiber bundle image. The pixels of the image of the uniformly illuminated sample are consistent and do not themselves have any negative impact on the analysis method 400, ensuring a more accurate determination of the pixel information for the corresponding fiber center position in the reference image.
The uniformly luminescent sample may be a uniformly fluorescent sample. Thus, the reference image is a fiber bundle image with a constant fluorescence rate. FIG. 5 illustrates a reference image acquired by sampling a homogeneous fluorescent sample according to one embodiment of the present invention. In the practical application of the fiber bundle image, a sample emitting fluorescence is generally imaged. Therefore, the accuracy of the analysis method is better guaranteed by the reference image obtained by sampling the uniform fluorescence sample. It will be appreciated that the homogeneous fluorescent sample is merely exemplary and not limiting, and that the reference image may also be acquired by sampling samples emitting other visible light.
In step S420, a reference pixel in the reference image acquired in step S410 is determined. The pixel value of the reference pixel is higher than that of the peripheral pixels, and the reference pixel corresponds to the center of one unique optical fiber in the optical fiber bundle.
As described above and shown in fig. 1, there are cells in the bundle image that correspond one-to-one to the respective optical fibers. The pixel value information for the cell may be used to determine a reference pixel corresponding to the center of an optical fiber in the fiber bundle. In general, the reference pixel corresponding to the center of the optical fiber in the optical fiber bundle is the pixel having the highest brightness among all the pixels corresponding to the optical fiber, i.e., the pixel having the largest pixel value. In other words, the pixel value of the reference pixel corresponding to the center of the fiber is higher than the pixel values of its peripheral pixels (i.e., other pixels corresponding to the same fiber). FIG. 6 shows a partially enlarged schematic view of a reference image according to one embodiment of the invention. FIG. 7 illustrates a schematic diagram of a pixel corresponding to the center of an optical fiber in the enlarged partial schematic diagram of the reference image shown in FIG. 6, according to one embodiment of the invention. For clarity, in the schematic diagram shown in FIG. 7, the pixel values of the reference pixels corresponding to the center of the fiber are identified with a "+" sign.
Alternatively, as previously described, a one-dimensional array may be employed to represent the determined location of the reference pixel.
In step S430, the pixel position of the corresponding fiber center in the fiber bundle image collected by using the same fiber bundle is determined according to the pixel position of the reference pixel in the reference image.
As described above, since the relative positions of the optical fibers in the optical fiber bundle are fixed, the relative positions between pixels corresponding to the centers of the optical fibers in the optical fiber bundle image acquired by using the same optical fiber bundle are also fixed. Therefore, according to the pixel position of the reference pixel in the reference image, the position of the corresponding optical fiber center in all the optical fiber bundle images acquired by using the same optical fiber bundle can be determined, especially for the condition that the far end and the near end of the optical fiber bundle are kept unchanged.
FIG. 8 shows a schematic diagram of a fiber optic bundle image identifying pixels therein corresponding to the centers of the optical fibers, according to one embodiment of the present invention. In the diagram shown in fig. 8, the pixel value of the pixel corresponding to the center of the optical fiber is assigned to 0.
In the above-described optical fiber bundle image analysis method, the reference image is used to determine the pixel information of the position corresponding to the center of the optical fiber in the other optical fiber bundle images. Compared with the method that the pixel information corresponding to the position of the center of the optical fiber is determined directly based on the pixel value of the optical fiber bundle image, the analysis method has the advantages that the result is not influenced by the imaging object in the optical fiber bundle image, and the result is accurate. In addition, because the analysis method only aims at the pixel corresponding to the center of the optical fiber in the reference image, and the expressive force of the pixel is strongest, the analysis accuracy is ensured, the calculation amount is greatly reduced, and the analysis time is shortened.
Optionally, the step S420 may specifically include the step S421 and the step S422.
In step S421, image segmentation is performed on the reference image to determine a fiber bundle imaging region in the reference image. As shown in the reference image shown in fig. 5, the reference image includes the fiber bundle imaging area and the background area without practical meaning. The imaging area of the optical fiber bundle is a middle circular area. While the background area is a black area around the circular area, which is meaningless for the analysis of the image. The image segmentation may be performed by image segmentation processing such as threshold segmentation and a region growing method. The image segmentation operation may further reduce the computational load of the overall image processing method.
In step S422, reference pixels are determined in the fiber bundle imaging region.
In one example, the fiber bundle imaging area is first processed using the area maxima method. Then, the pixel whose pixel value is the local maximum value is determined as the reference pixel. The region maximum method is an image segmentation method. As described above, the pixel corresponding to the center of the optical fiber in the optical fiber bundle is the highest-brightness pixel among all the pixels corresponding to the optical fiber, i.e., the brightest pixel in one cell. And performing image analysis on the reference image by using a region maximum value method, and taking the pixel with the region maximum value as a reference pixel corresponding to the center of the optical fiber.
In the above example, the local maximum method is used to determine the reference pixel, which effectively utilizes the following objective laws: for all pixels in the reference image corresponding to one fiber, the pixel corresponding to the center of the fiber has the highest pixel value compared with other pixels. Therefore, the method can quickly and accurately determine the central pixel value of the reference optical fiber, so that the quick and accurate analysis of the optical fiber bundle image can be ensured.
It will be appreciated by those of ordinary skill in the art that the region maxima method is merely exemplary and not limiting to the invention, and that other methods may be used to determine the reference fiber center pixel value, such as empirical thresholding.
It will be appreciated that the aforementioned fiber bundle image analysis method may be included in the fiber bundle image processing method. Information of pixels corresponding to the position of the center of the optical fiber in the bundle image including the sample image can be determined by the bundle image analysis method. Thereby, more accurate information is obtained. In particular, the respective positions of the sample image may be queried according to the positions of pixels corresponding to the fiber centers in the reference image, determined in the fiber bundle image analysis method. First, the number of rows and columns where the pixel y is located is determined according to the position Py of the reference pixel y and the width of the fiber bundle image. Then, the pixel value of the position of the sample image is inquired according to the row number and the column number of the pixel y, and the pixel information of the pixel in the sample image can be obtained.
Therefore, the optical fiber bundle image analysis method provides an accurate analysis result for the optical fiber bundle image processing method, so that the optical fiber bundle image processing method is small in calculation amount and good in processing effect.
In one embodiment, the pixel information determined in step S210 is corrected using the background image. Specifically, the pixel information determined in step S210 may be corrected according to the following formula.
F＝(Is-Ib)x K，
Where F denotes a pixel value after correction of a pixel in the sample image, IsRepresents the pixel value, I, determined in step S210bWhich represents the pixel value of the corresponding pixel in the background image, and K represents the correction coefficient.
Optionally, the background image is an image generated by imaging a non-luminescent sample, such as a fiber bundle image with zero fluorescence. For example, a sample without fluorescence may be sampled to acquire the background image. The pixel values in the background image do not change as long as the proximal end of the fiber bundle does not change. By "corresponding pixels" is meant that the pixels are located at the same position in the respective images, and that the pixels correspond to substantially the same position (e.g., center of optical fibers) of the same optical fiber in the bundle. Accordingly, the corresponding position in the background image may be queried according to the position of the pixel corresponding to the center of the optical fiber determined in step S210 to obtain the pixel value of the corresponding pixel in the background image.
If the pixel position of the corresponding fiber center in step S210 is determined by the aforementioned fiber bundle image analysis method 400, the corresponding position in the background image can be directly queried according to the position of the reference pixel in the reference image. And inquiring the background image according to the position of the pixel, namely obtaining the pixel value of the corresponding pixel in the background image. It will be appreciated that the corresponding pixel in the background image also corresponds to the center of the same fiber.
In the above-described embodiment, for each pixel value I determined in step S210sFirst, the pixel value I of the corresponding pixel in the background image and the calculated value I are calculatedbThe difference value of (a) is referred to as a first difference value for short; then, the product of the difference and the correction coefficient is calculated. The correction factor K may be any real number between 0.5 and 1.5. The correction coefficient K may be set empirically.
Optionally, the method can also be used according to a background image and a reference imageFor example, the correction coefficient K is calculated using the following formula: K/(I)c-Ib) Wherein, IcRepresenting the pixel value, I, of the corresponding pixel in the reference imagebRepresenting the pixel value of the corresponding pixel in the background image, and k represents a scaling factor, which is equal to the median of the differences between the pixel values of the pixels in the reference image and their corresponding pixel in the background image, respectively.
The reference image may be a reference image involved in the fiber bundle image analysis method described above. In one example, first, for each pixel at the position corresponding to the center of the optical fiber in the reference image, the difference, referred to as standard deviation, between the pixel and the corresponding pixel in the background image is calculated. By calculating the standard deviation in this way, the calculation amount is smaller while the calculation accuracy is ensured. Alternatively, it is also possible to calculate the difference of each pixel in the reference image from the corresponding pixel in the background image to obtain the standard deviation. The median k of all standard deviations was calculated. Then, for the pixel value I determined in step S210sCalculating the pixel value I of the corresponding pixel in the reference imagecAnd the pixel value I of the corresponding pixel in the background imagebThe difference value of (d) is referred to as the second difference value for short. Finally, a correction coefficient K is determined according to the quotient of the median K and the second difference.
The correction operation in this example can obtain a more desirable correction effect without requiring complicated calculation, thereby obtaining a desired image processing result.
Optionally, the step S230 includes: and (5) obtaining a reconstructed pixel value of the pixel by adopting an interpolation method based on the weight of the pixel and the pixel information corrected in the step (S220). The corrected pixel information is more faithfully reflected on the imaging target, and the correction operation is only performed on the pixel corresponding to the center of the optical fiber. Therefore, for each pixel in the bundle image, its weight can be determined according to the position of the pixel corresponding to the center of the fiber, which is closer to it.
Fig. 9 shows a schematic flow chart of step S230 according to an embodiment of the present invention. As shown in fig. 9, step S230 may include:
in step S231, the sample image is triangulated based on the pixel information determined in step S210.
In particular, the pixels corresponding to the centers of the fibers in the fiber bundle are a finite set of points in the sample image. All vertices of the triangle are formed from the set of points. The sample image is cut into a plurality of triangles. Where any two triangles either do not intersect or just intersect at a common edge.
Optionally, the triangulation is implemented by using delaunay triangulation algorithm. Although the arrangement of the optical fibers in the bundle is irregular, the distance between the centers of adjacent optical fibers is approximately uniform, approximately equal to the diameter of the optical fibers. Fig. 10 illustrates a portion of a sample image triangulated within a delaunay according to one embodiment of the present invention. As shown in fig. 10, a unique triangulation result can be obtained by using the delaunay triangulation algorithm, and it can be ensured that no vertex of another triangle appears in the circumscribed circle of any triangle. The triangulation algorithm is more suitable for the image processing method according to the embodiment of the invention, and a more ideal image processing result can be obtained.
Step S232, determining the weight of the pixel based on the triangle where the pixel is located and obtained by the triangulation.
For any pixel in the fiber bundle image, the weight may have a plurality of values, each weight corresponding to a pixel at a closer distance from the center of the corresponding fiber. For simplicity, the pixel corresponding to the weight may be referred to as a reference pixel. It will be appreciated that each reference pixel is the vertex of a triangle obtained by triangulation. The final pixel value of the pixel can be determined according to the weight of the pixel and the pixel value of the reference pixel corresponding to the pixel.
Optionally, for any pixel in the fiber bundle image, the farther it is from a certain reference pixel, the smaller the weight of the pixel for the reference pixel; otherwise, the reverse is carried out.
Illustratively, for each pixel in the fiber bundle image, its weight is determined by the location of 3 reference pixels. A weight may be determined for each of the 3 reference pixels, thereby forming oneA weight look-up table. Table 1 shows a weight lookup table according to one embodiment of the invention. In table 1, the first weight, the second weight, and the third weight represent the weights of the pixel whose weight is to be determined with respect to the first reference pixel, the second reference pixel, and the third reference pixel, respectively. As shown in Table 1, for pixel x1In other words, the first weight and the third weight are equal and relatively small, which means that they are equidistant from the first reference pixel and the third reference pixel, and the distance is relatively far; the second weight is relatively large, indicating that it is relatively close to the second reference pixel.
Table 1 weight lookup table
Figure RE-GDA0001495173550000101
Based on the results of the triangulation, each pixel in the sample image has a unique triangle located either on three sides of the triangle or inside the triangle. The three vertices of the triangle where the only triangle is located can be used as the reference pixel of the pixel. From the distances between the pixel and the three reference pixels, the weight of the pixel corresponding to each reference pixel can be determined.
For each pixel in the sample image, first, the distance of the pixel to each vertex of the triangle (i.e., the reference pixel) in which the pixel is located may be determined. The pixels may be located on the sides or inside the triangle. Then, according to the distances between the pixel and the three vertexes of the triangle, determining the weights of the pixel corresponding to the three vertexes of the triangle. Optionally, for a vertex of the triangle, the pixel is set to correspond to the vertex weight as being inversely proportional to a distance between the pixel and the vertex. For example, the pixels located at the outer center of the triangle have a weight of 0.333 corresponding to each of their reference pixels. For a pixel located at the vertex of a triangle, it can be considered that its weight corresponding to the vertex at which it is located is 1, and the weights corresponding to the other two vertices are 0. The weight of each pixel is determined by the method, the reconstruction effect is more ideal, and the process is simple and easy to implement.
The weight of each pixel in the optical fiber bundle image is obtained based on triangulation, and the calculation amount is smaller while the accuracy of the calculation result is ensured.
The delaunay triangulation algorithm given above is only an example and other methods may be used to obtain the weight of each pixel, such as the Krig (Krig) method.
It is to be understood that the above manner of determining the weights is merely an example, and not a limitation. For example, although in the above example the weight of each pixel is determined in dependence on the position of 3 reference pixels, this is merely illustrative and not limiting of the invention. For example, the weight of each pixel may also be determined according to 1 reference pixel, 4 or more reference pixels, which are closest to the pixel. As another example, the weights of the pixels may be set empirically.
Step S233, a reconstructed pixel value of the pixel is calculated by a linear interpolation method according to the weight of the pixel.
Alternatively, the reconstructed pixel value Gx of the pixel x of the reconstructed image is calculated according to the following formula.
Gx is Wa Ga + Wb Gb + Wc Gc, wherein,
wa and Ga respectively represent the weight of the vertex a of the triangle where the pixel x corresponds to and the corrected pixel value of the vertex a,
wb and Gb denote the weight of the vertex b of the triangle where the pixel x corresponds to and the corrected pixel value of the vertex b,
wc and Gc respectively represent the weight of the vertex c of the triangle where the pixel x corresponds to and the corrected pixel value of the vertex c.
According to an embodiment of the invention, the fiber bundle image processing method further comprises the step of registering the reconstructed image and the further image. Wherein the further image may also be a reconstructed image. Image registration is used to calculate the relative displacement of the two images. After image registration, the same content of the two images will coincide spatially.
Alternatively, the registration operation may employ a correlation coefficient method. The correct displacement that can be used to register the two images is determined by searching for the maximum of the correlation coefficients for all possible displacements. The registration operation time is short by utilizing a correlation coefficient method, and the real-time requirement can be met.
Although the correlation coefficient registration method is relatively fast, the registration accuracy is low. Alternatively, the registration operation may also employ an iterative registration method. Although the iterative registration method is slow, the iterative registration method can meet the requirement of high precision.
According to an embodiment of the invention, the reconstructed image and the further image are iteratively registered directly on the basis of the position of the pixel corresponding to the center of the optical fiber in the fiber bundle, the corrected pixel information and the further image. In this embodiment, the registration operation utilizes only the relevant elements corresponding to the centers of the fibers in the fiber bundle, ignoring some other elements, such as pixels in the reconstructed image that do not correspond to the centers of the fibers in the fiber bundle. Therefore, the calculation precision of iterative registration is ensured, and the calculation speed of iterative registration is effectively improved.
In practical applications, in addition to rigid registration, non-rigid registration is sometimes required. For example, the human tissue to be examined by the doctor has peristalsis during the time period for acquiring the sample image; also for example, probe pressure changes cause local deformation of the target tissue, etc. during acquisition of the sample image. Therefore, optionally registering the reconstructed image and the further image comprises the following operations: firstly, carrying out rigid body registration on a reconstructed image and another image; then, resampling another image according to the rigid body registration result; finally, non-rigid registration is performed on the overlapping portion of the resampled other image and the reconstructed image. Alternatively, the non-rigid registration may employ a free-form deformation method or a dymont (Demons) registration algorithm. Fig. 11A, 11B, and 11C illustrate the process of the above-described non-rigid body registration. Fig. 11A and 11B show a reconstructed image and another image to be registered, respectively, according to an embodiment of the invention. The dashed rectangle illustrates the overlap of the two determined by rigid body registration. For this overlapping portion, another image is resampled. Fig. 11C shows a schematic diagram of the result of non-rigid registration of the overlapping portion of the resampled further image and the reconstructed image.
Since the previous image processing operation obtains the ideal reconstructed image more quickly, the image registration and splicing operation can be faster and more accurate.
According to another aspect of the invention, an optical fiber bundle image analysis device is also provided. The optical fiber bundle image analysis device comprises an image acquisition device, a memory and a processor. The image acquisition equipment is used for acquiring a reference image by using the optical fiber bundle. The memory is used for storing programs. The processor is used for running the program.
Wherein the program, when executed in the processor, is configured to perform the steps of:
step S1, determining a reference pixel in the reference image, wherein the pixel value of the reference pixel is higher than the pixel values of its peripheral pixels; and
and step S2, determining the pixel position of the corresponding optical fiber center in the optical fiber bundle image collected by the same optical fiber bundle according to the pixel position of the reference pixel.
Optionally, when the step S1 is executed, the following steps are specifically executed:
step S11, performing image segmentation on the reference image to determine a fiber bundle imaging area in the reference image; and
step S12, determining the reference pixel in the fiber bundle imaging area.
Optionally, when the step S12 is executed, the following steps are specifically executed:
processing the imaging area of the optical fiber bundle by using an area maximum value method; and
determining a pixel whose pixel value is a regional maximum as the reference pixel.
Optionally, the image acquisition device samples a homogeneous fluorescence sample with the fiber optic bundle to acquire the reference image.
By reading the above detailed description about the optical fiber bundle image processing method and the optical fiber bundle image analyzing method, the configuration and technical effects of the optical fiber bundle image analyzing apparatus can be understood, and for brevity, no further description is provided herein.
Furthermore, according to an embodiment of the present invention, there is also provided a storage medium on which program instructions are stored, which when executed by a computer or a processor cause the computer or the processor to perform the respective steps of the optical fiber bundle image analysis method according to an embodiment of the present invention and to implement the respective modules or units in the optical fiber bundle image analysis apparatus according to an embodiment of the present invention. The storage medium may include, for example, a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), a portable compact disc read only memory (CD-ROM), a USB memory, or any combination of the above storage media. The computer-readable storage medium may be any combination of one or more computer-readable storage media.
Although the illustrative embodiments have been described herein with reference to the accompanying drawings, it is to be understood that the foregoing illustrative embodiments are merely exemplary and are not intended to limit the scope of the invention thereto. Various changes and modifications may be effected therein by one of ordinary skill in the pertinent art without departing from the scope or spirit of the present invention. All such changes and modifications are intended to be included within the scope of the present invention as set forth in the appended claims.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, and for example, the division of the units is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another device, or some features may be omitted, or not executed.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the invention and aiding in the understanding of one or more of the various inventive aspects. However, the method of the present invention should not be construed to reflect the intent: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
It will be understood by those skilled in the art that all of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where such features are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.
The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some of the modules in the fiber-bundle image analysis apparatus according to embodiments of the present invention. The present invention may also be embodied as apparatus programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
The above description is only for the specific embodiment of the present invention or the description thereof, and the protection scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and the changes or substitutions should be covered within the protection scope of the present invention. The protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (4)

1. A fiber optic bundle image analysis method, comprising:
collecting a reference image by using an optical fiber bundle;
performing image segmentation on the reference image to determine a fiber bundle imaging area in the reference image, processing the fiber bundle imaging area by using an area maximum method, and determining a pixel with a pixel value being an area maximum value in the fiber bundle imaging area as a reference pixel in the reference image, wherein the pixel value of the reference pixel is higher than the pixel values of the peripheral pixels;
determining the pixel position of the corresponding optical fiber center in the optical fiber bundle image collected by using the same optical fiber bundle according to the pixel position of the reference pixel and extracting the pixel information of the pixel position of the corresponding optical fiber center;
correcting the extracted pixel information; and
reconstructing the fiber bundle image based on the corrected pixel information to obtain a reconstructed image;
wherein the correcting the extracted pixel information comprises calculating a corrected pixel value according to the following formula:
F＝(Is-Ib)x K，
wherein F represents the corrected pixel value, IsRepresenting the extracted pixel value, IbRepresenting the pixel values of the corresponding pixels in the background image obtained by sampling the non-fluorescent sample, and K represents the correction factor.
2. The method of claim 1, wherein said acquiring a reference image with a fiber optic bundle comprises:
sampling a homogeneous fluorescence sample with the fiber optic bundle to acquire the reference image.
3. An optical fiber bundle image analysis device comprising:
the image acquisition equipment is used for acquiring a reference image by using the optical fiber bundle;
a memory for storing a program;
a processor for running the program;
wherein the program, when executed in the processor, is configured to perform the steps of:
step S1, determining a reference pixel in the reference image, wherein the pixel value of the reference pixel is higher than the pixel values of its peripheral pixels; and
step S2, determining the pixel position corresponding to the center of the optical fiber in the optical fiber bundle image collected by the same optical fiber bundle according to the pixel position of the reference pixel and extracting the pixel information of the pixel position corresponding to the center of the optical fiber;
step S3, correcting the extracted pixel information; reconstructing the fiber bundle image based on the corrected pixel information to obtain a reconstructed image;
wherein the correcting the extracted pixel information comprises calculating a corrected pixel value according to the following formula:
F＝(Is-Ib)x K，
wherein F represents the corrected pixel value, IsRepresenting the extracted pixel value, IbRepresenting pixel values of corresponding pixels in a background image, and K represents a correction coefficient, wherein the background image is obtained by sampling a non-fluorescence sample;
wherein, the step S1 specifically includes the following steps:
step S11, performing image segmentation on the reference image to determine a fiber bundle imaging area in the reference image;
step S12, processing the fiber bundle imaging area by using a local maximum method, and determining a pixel in the fiber bundle imaging area whose pixel value is a local maximum as a reference pixel in the reference image.
4. The apparatus of claim 3, wherein the image acquisition device acquires the reference image by sampling a uniform fluorescence sample with the fiber optic bundle.
CN201710958665.7A 2017-10-16 2017-10-16 Optical fiber bundle image analysis method and device Active CN107622491B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201710958665.7A CN107622491B (en) 2017-10-16 2017-10-16 Optical fiber bundle image analysis method and device
PCT/CN2018/110252 WO2019076267A1 (en) 2017-10-16 2018-10-15 Optical fibre bundle image analysis method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710958665.7A CN107622491B (en) 2017-10-16 2017-10-16 Optical fiber bundle image analysis method and device

Publications (2)

Publication Number Publication Date
CN107622491A CN107622491A (en) 2018-01-23
CN107622491B true CN107622491B (en) 2022-03-11

Family

ID=61092402

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710958665.7A Active CN107622491B (en) 2017-10-16 2017-10-16 Optical fiber bundle image analysis method and device

Country Status (2)

Country Link
CN (1) CN107622491B (en)
WO (1) WO2019076267A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107622491B (en) * 2017-10-16 2022-03-11 苏州微景医学科技有限公司 Optical fiber bundle image analysis method and device
CN107678153B (en) * 2017-10-16 2020-08-11 苏州微景医学科技有限公司 Optical fiber bundle image processing method and device

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1758754A (en) * 2005-10-27 2006-04-12 中国科学院上海技术物理研究所 Method based on the focal plane array image space-time changing of optical fiber coupling

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2842628B1 (en) * 2002-07-18 2004-09-24 Mauna Kea Technologies "METHOD OF PROCESSING AN IMAGE ACQUIRED BY MEANS OF A GUIDE CONSISTING OF A PLURALITY OF OPTICAL FIBERS"
CN104933707B (en) * 2015-07-13 2018-06-08 福建师范大学 A kind of super-pixel reconstruct segmentation and method for reconstructing based on multiphoton confocal microscopic cell images
CN107621463B (en) * 2017-10-16 2024-03-22 苏州微景医学科技有限公司 Image reconstruction method and device and microscopic imaging device
CN107622491B (en) * 2017-10-16 2022-03-11 苏州微景医学科技有限公司 Optical fiber bundle image analysis method and device
CN107678153B (en) * 2017-10-16 2020-08-11 苏州微景医学科技有限公司 Optical fiber bundle image processing method and device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1758754A (en) * 2005-10-27 2006-04-12 中国科学院上海技术物理研究所 Method based on the focal plane array image space-time changing of optical fiber coupling

Also Published As

Publication number Publication date
CN107622491A (en) 2018-01-23
WO2019076267A1 (en) 2019-04-25

Similar Documents

Publication Publication Date Title
CN107678153B (en) Optical fiber bundle image processing method and device
CN104508704B (en) Human body measurement method
Quinn et al. Rapid quantification of pixel-wise fiber orientation data in micrographs
CN111091562B (en) Method and system for measuring size of digestive tract lesion
CN102860814B (en) OCT (Optical Coherence Tomography) synthetic fundus image optic disc center positioning method and equipment
CN111932492B (en) Medical image processing method and device and computer readable storage medium
JP2015536732A (en) Image processing apparatus and method
CN107622491B (en) Optical fiber bundle image analysis method and device
JP6442311B2 (en) Technology for extracting tumor contours in nuclear medicine images
CN113808177A (en) Registration method and system for medical image and three-dimensional pathological image
WO2013070945A1 (en) Image analysis systems having image sharpening capabilities and methods using same
Bayareh Mancilla et al. Anatomical 3D modeling using IR sensors and radiometric processing based on structure from motion: Towards a tool for the diabetic foot diagnosis
JP6442309B2 (en) Nuclear medicine image analysis technology
WO2006134430A3 (en) Apparatus for determining myocardial iron accumulation by analysing t2* magnetic resonance images
CN111951241B (en) Method for measuring and displaying muscle deformation in aquatic animal exercise process
CN115049712A (en) Double-peak registration device for MPI-CT (Multi-phase Multi-CT) combined imaging of small animals and automatic registration method thereof
JP6442310B2 (en) Technology for extracting tumor regions from nuclear medicine images
WO2016125349A1 (en) Nuclear medical image analysis technique
Tang et al. Fast post-processing pipeline for optical projection tomography
CN113177953B (en) Liver region segmentation method, liver region segmentation device, electronic equipment and storage medium
CN106204609A (en) The process of Laser scanning confocal microscope lung image and analysis system and method
CN110473157A (en) A kind of two-dimensional ct image bearing calibration, mobile terminal and electronic equipment
CN116211255A (en) Fluorescent molecular tomography reconstruction method, system, medium, equipment and terminal
Haji Rassouliha A Toolbox for Precise and Robust Deformation Measurement
CN114359129A (en) DR image analysis method and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20180508

Address after: 215123 B902 room 388, Shui Shui Road, Suzhou Industrial Park, Suzhou, Jiangsu

Applicant after: Suzhou micro view medical science and Technology Co., Ltd.

Applicant after: Nanjing Gen Rui Medical Technology Co Ltd

Address before: 210061 room 810-2, building A, phase 1, China Danish Life Science Industrial Park, No. 3-1, new Kumho Road, Nanjing hi tech Development Zone, Jiangsu

Applicant before: Nanjing Gen Rui Medical Technology Co Ltd

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20190709

Address after: 215123 B902 room 388, Shui Shui Road, Suzhou Industrial Park, Suzhou, Jiangsu

Applicant after: Suzhou micro view medical science and Technology Co., Ltd.

Address before: 215123 B902 room 388, Shui Shui Road, Suzhou Industrial Park, Suzhou, Jiangsu

Applicant before: Suzhou micro view medical science and Technology Co., Ltd.

Applicant before: Nanjing Gen Rui Medical Technology Co Ltd

GR01 Patent grant
GR01 Patent grant