CN115330624A - Method and device for acquiring fluorescence image and endoscope system - Google Patents
Method and device for acquiring fluorescence image and endoscope system Download PDFInfo
- Publication number
- CN115330624A CN115330624A CN202210986551.4A CN202210986551A CN115330624A CN 115330624 A CN115330624 A CN 115330624A CN 202210986551 A CN202210986551 A CN 202210986551A CN 115330624 A CN115330624 A CN 115330624A
- Authority
- CN
- China
- Prior art keywords
- fluorescence
- image
- images
- acquiring
- detected object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000002073 fluorescence micrograph Methods 0.000 title claims abstract description 64
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000004927 fusion Effects 0.000 claims abstract description 35
- 230000009466 transformation Effects 0.000 claims abstract description 19
- 238000007781 pre-processing Methods 0.000 claims abstract description 15
- 238000012545 processing Methods 0.000 claims abstract description 12
- 230000009467 reduction Effects 0.000 claims description 16
- 238000000354 decomposition reaction Methods 0.000 claims description 12
- 238000004422 calculation algorithm Methods 0.000 claims description 10
- 238000006243 chemical reaction Methods 0.000 claims description 8
- 230000005284 excitation Effects 0.000 claims description 8
- 230000001678 irradiating effect Effects 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 230000002708 enhancing effect Effects 0.000 abstract description 4
- 238000004891 communication Methods 0.000 description 4
- 230000007797 corrosion Effects 0.000 description 4
- 238000005260 corrosion Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000001575 pathological effect Effects 0.000 description 3
- 238000010187 selection method Methods 0.000 description 3
- 238000011282 treatment Methods 0.000 description 3
- 238000001917 fluorescence detection Methods 0.000 description 2
- 210000002784 stomach Anatomy 0.000 description 2
- 206010028980 Neoplasm Diseases 0.000 description 1
- 208000025865 Ulcer Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 238000001727 in vivo Methods 0.000 description 1
- 230000003902 lesion Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000000214 mouth Anatomy 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011369 optimal treatment Methods 0.000 description 1
- 239000011148 porous material Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 210000004881 tumor cell Anatomy 0.000 description 1
- 231100000397 ulcer Toxicity 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G06T5/70—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration by the use of local operators
- G06T5/30—Erosion or dilatation, e.g. thinning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10064—Fluorescence image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10068—Endoscopic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30096—Tumor; Lesion
Abstract
The invention discloses a method, a device and an endoscope system for acquiring a fluorescence image, wherein the method comprises the steps of acquiring a plurality of fluorescence source images of a detected object; carrying out image preprocessing on the multiple fluorescence source images to obtain multiple fluorescence sample images; and carrying out image fusion on the multiple fluorescence sample images to obtain a fluorescence image of the detected object. The invention acquires the fluorescence source image of the detected object through a plurality of image sensors, performs image denoising and enhancing processing on the fluorescence source image, and performs image fusion through wavelet transformation to obtain the fluorescence image with higher resolution, clearer image and high fusion speed.
Description
Technical Field
The invention relates to the technical field of image acquisition, in particular to a method and a device for acquiring a fluorescence image and an endoscope system.
Background
The endoscope is a detection instrument integrating traditional optics, ergonomics, precision machinery, modern electronics, mathematics and software into a whole, and can enter the stomach through the oral cavity or enter the body through other natural pores. Since the lesion which cannot be displayed by X-ray can be seen by the endoscope, it is very useful for a doctor who can observe, for example, an ulcer or a tumor in the stomach by the endoscope, and thus can make an optimal treatment plan.
Because the fluorescence intensity of the cancerous or pathological tissue is weaker than that of the normal tissue, the contrast between the pathological tissue and the normal tissue is increased by marking the tumor cells with the fluorescent agent, but the defects are very obvious when the pathological tissue is collected by adopting a single sensor, such as the defects in the aspects of resolution, spectrum and the like.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides a method and a device for acquiring a fluorescence image and an endoscope system.
In a first aspect, a method for acquiring a fluorescence image, applied to a medical endoscope, includes the steps of:
collecting a plurality of fluorescence source images of a detected object;
performing image preprocessing on the plurality of fluorescence source images to obtain a plurality of fluorescence sample images;
and carrying out image fusion on the multiple fluorescence sample images to obtain a fluorescence image of the detected object.
Further, the acquiring a plurality of fluorescence source images of the detected object specifically comprises:
irradiating excitation light to the detected object to form a fluorescent target object;
and acquiring the fluorescent target object by adopting a plurality of image sensors to obtain a plurality of fluorescent source images of the detected object.
Further, the image preprocessing is performed on the multiple fluorescence source images to obtain multiple fluorescence sample images, specifically:
respectively carrying out noise reduction treatment on the multiple fluorescence source images by adopting a top-hat transformation algorithm to obtain noise reduction images of the multiple fluorescence source images;
and respectively carrying out image enhancement on the plurality of noise reduction images to obtain a plurality of fluorescence sample images.
Further, the image fusion is performed on the multiple fluorescence sample images to obtain a fluorescence image of the detected object, specifically:
respectively carrying out discrete wavelet transformation on the multiple fluorescence sample images so as to carry out wavelet decomposition on the multiple fluorescence sample images to obtain low-frequency information and high-frequency information of the multiple fluorescence sample images;
fusing the low-frequency information and the high-frequency information of the multiple fluorescence sample images by adopting a fusion rule to obtain fused fluorescence image components;
and reconstructing the fused fluorescence image component to obtain a fluorescence image of the detected object.
In a second aspect, an apparatus for acquiring a fluorescence image includes:
an image acquisition module: the fluorescence source images are used for acquiring a plurality of detected objects;
an image preprocessing module: the fluorescence source images are subjected to image preprocessing to obtain a plurality of fluorescence sample images;
an image fusion module: and the fluorescence detection device is used for carrying out image fusion on the multiple fluorescence sample images to obtain a fluorescence image of the detected object.
Further, the image acquisition module is specifically configured to:
irradiating excitation light to the detected object to form a fluorescent target object;
and acquiring the fluorescent target object by adopting a plurality of image sensors to obtain a plurality of fluorescent source images of the detected object.
Further, the image preprocessing module is specifically configured to:
respectively carrying out noise reduction processing on the multiple fluorescence source images by adopting a top-hat conversion algorithm to obtain noise reduction images of the multiple fluorescence source images;
and respectively carrying out image enhancement on the plurality of noise reduction images to obtain a plurality of fluorescence sample images.
Further, the image fusion module is specifically configured to:
respectively carrying out discrete wavelet transformation on the multiple fluorescence sample images so as to carry out wavelet decomposition on the multiple fluorescence sample images to obtain low-frequency information and high-frequency information of the multiple fluorescence sample images;
fusing the low-frequency information and the high-frequency information of the multiple fluorescence sample images by adopting a fusion rule to obtain fused fluorescence image components;
and reconstructing the fused fluorescence image component to obtain a fluorescence image of the detected object.
In a third aspect, an apparatus for acquiring a fluorescence image comprises a processor, an input device, an output device, and a memory, wherein the processor, the input device, the output device, and the memory are connected to each other, wherein the memory is used for storing a computer program, and the computer program comprises program instructions, and the processor is configured to call the program instructions to execute the method according to the first aspect.
In a fourth aspect, an endoscope system is characterized by comprising:
the medical endoscope is used for acquiring a plurality of fluorescence source images of a detected object;
and the device for acquiring the fluorescence image according to the third aspect, wherein the device for acquiring the fluorescence image is in communication connection with the medical endoscope and is used for carrying out image processing fusion on the multiple fluorescence source images.
The invention has the following beneficial effects: the method comprises the steps of collecting fluorescence source images of a detected object through a plurality of image sensors, carrying out image denoising and enhancing processing on the fluorescence source images, and carrying out image fusion through wavelet transformation to obtain a fluorescence image with higher resolution, clearer image and high fusion speed.
Drawings
In order to more clearly illustrate the detailed description of the invention or the technical solutions in the prior art, the drawings that are needed in the detailed description of the invention or the prior art will be briefly described below. Throughout the drawings, like elements or portions are generally identified by like reference numerals. In the drawings, elements or portions are not necessarily drawn to scale.
FIG. 1 is a flow chart of a method for obtaining a fluorescence image according to an embodiment of the present invention;
FIG. 2 is a sample image decomposition flow chart of a method for obtaining a fluorescence image according to an embodiment of the present invention;
FIG. 3 is a block diagram of an apparatus for acquiring fluorescence images according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of an apparatus for acquiring a fluorescence image according to an embodiment of the present invention;
fig. 5 is a block diagram of an endoscope system according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The following examples are only for illustrating the technical solutions of the present invention more clearly, and therefore are only examples, and the protection scope of the present invention is not limited thereby.
It is to be noted that, unless otherwise specified, technical or scientific terms used herein shall have the ordinary meaning as understood by those skilled in the art to which the invention pertains.
As shown in fig. 1, a method for acquiring a fluorescence image, applied to a medical endoscope, comprises the steps of:
s1: collecting a plurality of fluorescence source images of a detected object;
specifically, the fluorescence excitation light generates fluorescence and near infrared rays with certain wavelengths, transmits through a living organism, excites in-vivo fluorescence, and irradiates the detected object with the fluorescence excitation light as excitation light to form a fluorescence target object. The fluorescent target object is collected by adopting the plurality of image sensors, a plurality of fluorescent source images of the detected object are obtained, the target state can be reflected more comprehensively, and the image quality is improved.
S2: carrying out image preprocessing on the multiple fluorescence source images to obtain multiple fluorescence sample images;
specifically, a structural element is constructed, the structural element is used for carrying out opening operation on the multiple fluorescence source images, and then top-hat transformation is carried out on the multiple fluorescence source images after the opening operation. And respectively carrying out noise reduction treatment on the multiple fluorescence source images by adopting a top-hat conversion algorithm to obtain noise reduction images of the multiple fluorescence source images.
Further, when performing top-hat conversion on a plurality of fluorescence source images respectively, the same top-hat conversion method is used to perform top-hat conversion on each fluorescence source image simultaneously, and in order to facilitate understanding of the top-hat algorithm process performed on the fluorescence source images, in this embodiment, taking one of the fluorescence source images f as an example, a structural element is set as SE, the size of the structural element is m × n, the size of the fluorescence source image f is W × H, and the shape of the structural element SE should be as similar as possible to the shape of the fluorescence source image f.
Firstly, the same structural element SE is used for corroding and then expanding the fluorescence source image f to carry out the opening operation, wherein the operation formula of the opening operation is as follows:
in the formula, f SE indicates the corrosion process of a fluorescence source image, a structure element SE is used for corroding a fluorescence source image f, when the original point of the structure element SE is translated to a certain pixel point of the fluorescence source image f, if the structure element SE is at the pixel point and the structure element SE is completely contained in the overlapped area of the fluorescence source image f, the pixel point corresponding to the output image after corrosion is assigned to be 1, otherwise, the assignment is 0, and the overall color tone of the corroded image is darkened; (f SE) ≦ SE indicates that the fluorescence source image output after corrosion is used for expansion processing, the fluorescence source image f after corrosion is expanded by the structural element SE, the original point of the structural element SE is translated to a certain pixel point position of the fluorescence source image f, if the intersection of the structural element SE at the pixel point position and the fluorescence source image f is not empty, the pixel point corresponding to the output image after expansion is assigned to be 1, otherwise, the pixel point is 0, and the overall color tone of the image after expansion becomes bright.
And (3) subtracting the fluorescence source image after the opening operation from the original fluorescence source image to obtain a top-hat conversion on the fluorescence source image, wherein the gray value f of the image pixel after the opening operation is less than or equal to the original gray value, and the noise reduction image of the fluorescence source image is obtained. Therefore, the calculation formula of the top-hat transformation of the fluorescent source image is as follows:
the method for enhancing the images includes but is not limited to the mode of carrying out one or more combined image enhancement transformations such as cutting, scaling transformation, translation transformation, scale transformation, contrast transformation, color transformation and the like on the fluorescence sample images.
S3: carrying out image fusion on the multiple fluorescence sample images to obtain a fluorescence image of the detected object;
specifically, a Mallat algorithm of discrete wavelet transform is adopted to decompose a plurality of fluorescence sample images respectively to obtain low-frequency information and high-frequency information of the fluorescence sample images, in this embodiment, decomposition of one of the fluorescence sample images is taken as an example, and a decomposition flow is shown in fig. 2.
As can be seen from fig. 2, the first decomposition yields 4 sub-images of the fluorescence sample: LL1, HL1, LH1, and HH1; the method comprises the following steps that LL1 is a low-frequency sub-image, HL1, LH1 and HH1 are high-frequency sub-images, LL1 comprises low-frequency information in the horizontal direction and the vertical direction, LH1 comprises low-frequency information in the horizontal direction and the vertical direction and high-frequency information in the vertical direction, HL1 comprises high-frequency information in the horizontal direction and the vertical direction, HH1 comprises high-frequency information in the horizontal direction and the vertical direction, and only the low-frequency sub-image LL1 is decomposed in the next decomposition.
After the low-frequency information and the high-frequency information of the multiple fluorescence sample images are obtained through decomposition, fusion processing is carried out on the low-frequency information and the high-frequency information by adopting different fusion rules, so that fusion of image component information is completed, and fused fluorescence image components are obtained. The low-frequency information determines the contour of the fluorescence image, the adopted fusion rules include but are not limited to linear weighting and fusion based on regional variance, the high-frequency information reflects the detail information such as the edge, curve, texture and the like of the fluorescence image, and the adopted fusion rules include but are not limited to wavelet regional energy selection method, modulus value selection method and regional average gradient selection method.
And after the fused fluorescence image component is obtained, reconstructing by adopting a Mallat algorithm through wavelet inverse transformation, wherein the reconstruction process is the inverse process of the fluorescence sample image decomposition, thereby obtaining the fluorescence image of the detected object. The fused fluorescence image has better visual effect, can clearly see the target in the image, and enhances the edge detail information of the fluorescence image compared with the original image.
Based on the same inventive concept, an embodiment of the present invention provides an apparatus for acquiring a fluorescence image, as shown in fig. 3, including:
an image acquisition module: the fluorescence source images are used for acquiring a plurality of detected objects;
an image preprocessing module: the fluorescence source images are subjected to image preprocessing to obtain a plurality of fluorescence sample images;
an image fusion module: and the fluorescence detection device is used for carrying out image fusion on the multiple fluorescence sample images to obtain a fluorescence image of the detected object.
Further, the image acquisition module is specifically configured to:
irradiating excitation light to the detected object to form a fluorescent target object;
and acquiring the fluorescent target object by adopting a plurality of image sensors to obtain a plurality of fluorescent source images of the detected object.
Further, the image preprocessing module is specifically configured to:
respectively carrying out noise reduction treatment on the multiple fluorescence source images by adopting a top-hat transformation algorithm to obtain noise reduction images of the multiple fluorescence source images;
and respectively carrying out image enhancement on the plurality of noise reduction images to obtain a plurality of fluorescence sample images.
Further, the image fusion module is specifically configured to:
respectively carrying out discrete wavelet transformation on the multiple fluorescence sample images so as to carry out wavelet decomposition on the multiple fluorescence sample images to obtain low-frequency information and high-frequency information of the multiple fluorescence sample images;
fusing the low-frequency information and the high-frequency information of the multiple fluorescence sample images by adopting a fusion rule to obtain fused fluorescence image components;
and reconstructing the fused fluorescence image component to obtain a fluorescence image of the detected object.
The invention acquires the fluorescence source image of the detected object through a plurality of image sensors, performs image denoising and enhancing processing on the fluorescence source image, and performs image fusion through wavelet transformation to obtain the fluorescence image with higher resolution, clearer image and high fusion speed.
Optionally, in another embodiment of the present application, there is provided an apparatus for acquiring a fluorescence image, as shown in fig. 4, the apparatus for acquiring a fluorescence image may include: one or more processors 101, one or more input devices 102, one or more output devices 103, and memory 104, the processors 101, input devices 102, output devices 103, and memory 104 being interconnected via a bus 105. The memory 104 is used for storing a computer program comprising program instructions, the processor 101 being configured for invoking the program instructions to perform the methods of the above-described method embodiment parts.
It should be understood that, in the embodiment of the present invention, the Processor 101 may be a Central Processing Unit (CPU), a deep learning graphics card (e.g., NPU, england GPU, google TPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an FPGA (Field-Programmable Gate Array) or other Programmable logic device, a discrete Gate or transistor logic device, a discrete hardware component, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The input device 102 may include a keyboard, etc., and the output device 103 may include a display (LCD, etc.), speakers, etc.
The memory 104 may include both read-only memory and random access memory and provides instructions and data to the processor 101. A portion of the memory 104 may also include non-volatile random access memory. For example, the memory 104 may also store device type information.
In specific implementation, the processor 101, the input device 102, and the output device 103 described in the embodiment of the present invention may execute an implementation manner described in the embodiment of the method for acquiring a fluorescence image provided in the embodiment of the present invention, and details are not described herein again.
It should be noted that, in the embodiment of the present invention, a more specific workflow and related details of an apparatus for acquiring a fluorescence image are described with reference to the foregoing method embodiment section, and are not described herein again.
Optionally, in another embodiment of the present application, there is provided an endoscope system, as shown in fig. 5, comprising:
the medical endoscope is used for acquiring a plurality of fluorescence source images of a detected object;
and the device for acquiring the fluorescence image according to the embodiment is in communication connection with the medical endoscope, and is used for performing image processing and fusion on the multiple fluorescence source images.
It should be noted that, for more specific work flows of the endoscope system portion, please refer to the foregoing method embodiment portion, which is not described herein again.
Those of ordinary skill in the art will appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the components and steps of the various examples have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may also be an electrical, mechanical or other form of connection.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention essentially or partially contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A method for acquiring a fluorescence image, which is applied to a medical endoscope, is characterized by comprising the following steps:
collecting a plurality of fluorescence source images of a detected object;
performing image preprocessing on the plurality of fluorescence source images to obtain a plurality of fluorescence sample images;
and carrying out image fusion on the multiple fluorescence sample images to obtain a fluorescence image of the detected object.
2. The method for acquiring fluorescence images according to claim 1, wherein the acquiring a plurality of fluorescence source images of the detected object comprises:
irradiating excitation light to the detected object to form a fluorescent target object;
and acquiring the fluorescent target object by adopting a plurality of image sensors to obtain a plurality of fluorescent source images of the detected object.
3. The method according to claim 2, wherein the image preprocessing is performed on the plurality of fluorescence source images to obtain a plurality of fluorescence sample images, specifically:
respectively carrying out noise reduction processing on the multiple fluorescence source images by adopting a top-hat conversion algorithm to obtain noise reduction images of the multiple fluorescence source images;
and respectively carrying out image enhancement on the plurality of noise-reduced images to obtain a plurality of fluorescence sample images.
4. The method according to claim 3, wherein the image fusion is performed on the multiple fluorescence sample images to obtain the fluorescence image of the detected object, and specifically comprises:
respectively carrying out discrete wavelet transformation on the multiple fluorescence sample images so as to carry out wavelet decomposition on the multiple fluorescence sample images to obtain low-frequency information and high-frequency information of the multiple fluorescence sample images;
fusing the low-frequency information and the high-frequency information of the multiple fluorescence sample images by adopting a fusion rule to obtain fused fluorescence image components;
and reconstructing the fused fluorescence image component to obtain a fluorescence image of the detected object.
5. An apparatus for acquiring a fluorescence image, comprising:
an image acquisition module: the fluorescence source images are used for acquiring a plurality of fluorescence source images of the detected object;
an image preprocessing module: the fluorescence source images are subjected to image preprocessing to obtain a plurality of fluorescence sample images;
an image fusion module: and the fluorescence image fusion device is used for carrying out image fusion on the multiple fluorescence sample images to obtain a fluorescence image of the detected object.
6. The apparatus of claim 5, wherein the image acquisition module is configured to:
irradiating excitation light to the detected object to form a fluorescent target object;
and acquiring the fluorescent target object by adopting a plurality of image sensors to obtain a plurality of fluorescent source images of the detected object.
7. The apparatus for acquiring fluorescence images according to claim 6, wherein the image preprocessing module is specifically configured to:
respectively carrying out noise reduction processing on the multiple fluorescence source images by adopting a top-hat conversion algorithm to obtain noise reduction images of the multiple fluorescence source images;
and respectively carrying out image enhancement on the plurality of noise-reduced images to obtain a plurality of fluorescence sample images.
8. The apparatus for acquiring fluorescence images according to claim 7, wherein the image fusion module is specifically configured to:
respectively carrying out discrete wavelet transformation on the multiple fluorescence sample images so as to carry out wavelet decomposition on the multiple fluorescence sample images to obtain low-frequency information and high-frequency information of the multiple fluorescence sample images;
fusing the low-frequency information and the high-frequency information of the multiple fluorescence sample images by adopting a fusion rule to obtain fused fluorescence image components;
and reconstructing the fused fluorescence image component to obtain a fluorescence image of the detected object.
9. An apparatus for acquiring a fluorescence image, comprising a processor, an input device, an output device and a memory, the processor, the input device, the output device and the memory being interconnected, wherein the memory is configured to store a computer program comprising program instructions, the processor being configured to invoke the program instructions to perform the method according to any one of claims 1-4.
10. An endoscopic system, comprising:
the medical endoscope is used for acquiring a plurality of fluorescence source images of a detected object;
and the apparatus for acquiring fluorescence images according to claim 9, wherein the apparatus for acquiring fluorescence images is communicatively connected to the medical endoscope for image processing fusion of the plurality of fluorescence source images.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210986551.4A CN115330624A (en) | 2022-08-17 | 2022-08-17 | Method and device for acquiring fluorescence image and endoscope system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210986551.4A CN115330624A (en) | 2022-08-17 | 2022-08-17 | Method and device for acquiring fluorescence image and endoscope system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115330624A true CN115330624A (en) | 2022-11-11 |
Family
ID=83924710
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210986551.4A Pending CN115330624A (en) | 2022-08-17 | 2022-08-17 | Method and device for acquiring fluorescence image and endoscope system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115330624A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110772208A (en) * | 2019-10-31 | 2020-02-11 | 深圳开立生物医疗科技股份有限公司 | Method, device and equipment for acquiring fluorescence image and endoscope system |
| CN111223069A (en) * | 2020-01-14 | 2020-06-02 | 天津工业大学 | Image fusion method and system |
| CN111513660A (en) * | 2020-04-28 | 2020-08-11 | 深圳开立生物医疗科技股份有限公司 | Image processing method and device applied to endoscope and related equipment |
| CN114298980A (en) * | 2021-12-09 | 2022-04-08 | 杭州海康慧影科技有限公司 | Image processing method, device and equipment |
| CN114881905A (en) * | 2022-06-21 | 2022-08-09 | 西北工业大学 | Processing method for fusing infrared image and visible light image based on wavelet transformation |
-
2022
- 2022-08-17 CN CN202210986551.4A patent/CN115330624A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110772208A (en) * | 2019-10-31 | 2020-02-11 | 深圳开立生物医疗科技股份有限公司 | Method, device and equipment for acquiring fluorescence image and endoscope system |
| CN111223069A (en) * | 2020-01-14 | 2020-06-02 | 天津工业大学 | Image fusion method and system |
| CN111513660A (en) * | 2020-04-28 | 2020-08-11 | 深圳开立生物医疗科技股份有限公司 | Image processing method and device applied to endoscope and related equipment |
| CN114298980A (en) * | 2021-12-09 | 2022-04-08 | 杭州海康慧影科技有限公司 | Image processing method, device and equipment |
| CN114881905A (en) * | 2022-06-21 | 2022-08-09 | 西北工业大学 | Processing method for fusing infrared image and visible light image based on wavelet transformation |
Non-Patent Citations (1)
| Title |
|---|
| 许雪梅: "《微弱信号检测及无损探测技术研究》", pages: 406 - 407 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Bankman | Handbook of medical imaging: processing and analysis management | |
| Bankman | Handbook of medical image processing and analysis | |
| JP4895204B2 (en) | Image component separation device, method, and program, and normal image generation device, method, and program | |
| US7304644B2 (en) | System and method for performing a virtual endoscopy | |
| CN107408197A (en) | The system and method for the classification of cell image and video based on deconvolution network | |
| CN107146262B (en) | Three-dimensional visualization method and system for OCT (optical coherence tomography) image | |
| JPWO2020022027A1 (en) | Learning device and learning method | |
| Ly et al. | Full-view in vivo skin and blood vessels profile segmentation in photoacoustic imaging based on deep learning | |
| CN111784686A (en) | Dynamic intelligent detection method, system and readable storage medium for endoscope bleeding area | |
| CN102682439B (en) | Medical image fusion method based on multidirectional empirical mode decomposition | |
| CN111178502A (en) | Training method and system for circularly generating confrontation network model and electronic equipment | |
| JP2022548760A (en) | Slide-free histological imaging methods and systems | |
| Zhao et al. | Deep Learning‐Based Denoising in High‐Speed Portable Reflectance Confocal Microscopy | |
| CN115222992A (en) | Preoperative intraoperative image-based breast cancer lymph node benign and malignant classification system and method | |
| CN109829921B (en) | Method and system for processing CT image of head, equipment and storage medium | |
| CN115330624A (en) | Method and device for acquiring fluorescence image and endoscope system | |
| Lange et al. | Computer-aided-diagnosis (CAD) for colposcopy | |
| Ohura et al. | Computer-aided diagnosis method for detecting early esophageal cancer from endoscopic image by using dyadic wavelet transform and fractal dimension | |
| KR20200010661A (en) | Apparatus and method for diagnosing uterine lesion using deep leaking algorithm | |
| Wu et al. | Learned end-to-end high-resolution lensless fiber imaging toward intraoperative real-time cancer diagnosis | |
| CN114596256A (en) | Image analysis method for extracting space curvature characteristics of fibrous structure based on space orientation change in neighborhood | |
| Feineigle et al. | Processing of 3D DIC microscopy images for data visualization | |
| CN115880208A (en) | Image processing method, image processing apparatus, and medical device | |
| Salehi et al. | Investigation and simulation of different medical image processing algorithms to improve image quality using simulink matlab | |
| CN115578285B (en) | Mammary gland molybdenum target image detail enhancement method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |