CN112801913A - Method for solving field depth limitation of microscope - Google Patents
Method for solving field depth limitation of microscope Download PDFInfo
- Publication number
- CN112801913A CN112801913A CN202110175068.3A CN202110175068A CN112801913A CN 112801913 A CN112801913 A CN 112801913A CN 202110175068 A CN202110175068 A CN 202110175068A CN 112801913 A CN112801913 A CN 112801913A
- Authority
- CN
- China
- Prior art keywords
- image
- microscope
- channel
- color picture
- fusion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 18
- 230000004927 fusion Effects 0.000 claims abstract description 14
- 230000009466 transformation Effects 0.000 claims abstract description 7
- 238000005259 measurement Methods 0.000 claims abstract description 4
- 238000000354 decomposition reaction Methods 0.000 claims description 3
- 230000003287 optical effect Effects 0.000 abstract description 7
- 238000007499 fusion processing Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 206010003591 Ataxia Diseases 0.000 description 1
- 206010010947 Coordination abnormal Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 208000016290 incoordination Diseases 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000007500 overflow downdraw method Methods 0.000 description 1
- 238000010187 selection method Methods 0.000 description 1
- 239000004753 textile Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a method for solving the depth of field limitation of a microscope, which comprises the following steps: s1: shooting a plurality of pictures in different focal length ranges by using a camera; s2: pretreatment: converting the shot color picture into a gray image; s3: performing wavelet transformation; s4: fusion treatment: for the low-frequency subgraph, obtaining a low-frequency fusion coefficient by using the point sharpness and the fusion measurement in a pixel neighborhood, and for the high-frequency subgraph, fusing by using the sum of Laplacian operators in the pixel neighborhood; s5: inverse wavelet transform; s6: the gray level image of S5 is converted into a multi-channel picture, so that the problem that the depth of field is easily limited under the condition that the optical magnification of the optical microscope is large is solved, and the applicable scene of the optical microscope is greatly expanded.
Description
Technical Field
The invention relates to the technical field of digital image processing, in particular to a method for solving the problem of depth of field limitation of a microscope.
Background
With the increasing demand for microscopic world observation by humans, microscopes are also widely used in a variety of settings. However, the microscope has various inconveniences for the microscopic world observation. For example, focusing is slow, depth of field is easily limited, and the like, and particularly when the optical magnification is large and the fluctuation of an observation object in the Z-axis direction is large, the situation of local clear overall blurring is easily caused. In the process of microscopic detection of textile fibers, the unit often encounters the situations that the microscope is unstable in focusing and the definition of the picture is not uniform, so that a new technology is urgently needed to solve the problem so as to expand the application scene of the microscope.
Based on this, the present invention provides a method for solving the depth of field limitation of a microscope, so as to solve the above mentioned problems.
Disclosure of Invention
The present invention is directed to a method for solving the depth of field limitation of a microscope to solve the above-mentioned problems.
In order to achieve the purpose, the invention provides the following technical scheme: a method of resolving depth of field limitations of a microscope, said method comprising the steps of:
s1: shooting a plurality of pictures in different focal length ranges by using a camera;
s2: pretreatment: converting the shot color picture into a gray image;
s3: performing wavelet transformation: performing complex discrete wavelet transform on the gray level image in the S2 to perform multi-scale decomposition, and obtaining a plurality of subbands containing different scale details, thereby obtaining definition indexes between adjacent domains of pixels of the decomposed sub-image, and extracting detail information of different scales to construct a panoramic focused image;
s4: fusion treatment: for the low-frequency subgraph, obtaining a low-frequency fusion coefficient by using the point sharpness and the fusion measurement in a pixel neighborhood, and for the high-frequency subgraph, fusing by using the sum of Laplacian operators in the pixel neighborhood;
s5: wavelet inverse transformation: reconstructing a high-pass filter and a low-pass filter, performing convolution respectively, then summing, and converting information into a gray image;
s6: the grayscale image of S5 is converted into a multi-channel picture, i.e., a color picture.
Preferably, clear pictures are taken in the different focal length ranges, and the number of the pictures is 5-8.
Preferably, the color picture is a multi-channel image, and a formula for converting the color picture into a gray image is as follows:
where R, G and B are the three channels of the color picture, R represents the value of the position in the R channel, G represents the value of the position in the G channel, and B represents the value of the position in the B channel.
Compared with the prior art, the invention has the beneficial effects that: the invention can solve the problem that the depth of field is easily limited under the condition that the optical magnification of the optical microscope is larger, so that the applicable scene of the optical microscope is greatly expanded, the whole picture is clearer after the picture is processed, and the user experience is greatly improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of the method of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the present invention provides a technical solution: a method of resolving depth of field limitations of a microscope, said method comprising the steps of:
s1: shooting a plurality of photos in different focal length ranges by using a camera, wherein the photos are shot clearly in the different focal length ranges, the increase of calculated amount caused by more photos is not avoided, and the number of the photos is preferably 5-8;
s2: pretreatment: converting the shot color picture into a gray image, wherein the color picture is a multi-channel image, and a formula for converting the color picture into the gray image is as follows:
wherein R, G and B are the three channels of the color picture, R represents the value of the position in the R channel, G represents the value of the position in the G channel, and B represents the value of the position in the B channel;
compared with the traditional method for converting the gray-scale image, the gray-scale image processed by the formula can obtain more remarkable information characteristics and better contrast, and is more convenient for the subsequent processing.
S3: performing wavelet transformation: the grayscale image in S2 is subjected to a complex discrete wavelet transform for multi-scale decomposition, since the wavelet transform can well decompose the image and obtain a plurality of subbands containing different scale details. Therefore, the definition index between adjacent domains of each pixel of the sub-image can be obtained, and the detail information of different scales is extracted to construct a panoramic focused image so as to eliminate the block effect phenomenon caused by adopting a single fusion scale in the traditional spatial domain fusion method;
s4: fusion treatment: the sub-frequency bands extracted in the previous step are often regions with sharp brightness, so that the detail features can be well reflected. For the low-frequency subgraph, obtaining a low-frequency fusion coefficient by using the point sharpness and fusion measurement in a pixel neighborhood, and for the high-frequency subgraph, fusing by using the sum of Laplacian operators in the pixel neighborhood to reduce the influence of local noise on a definition operation result;
in the fusion process, in order to avoid that the fused image has improved noise level and saturation due to the fact that the fused pixel point exceeds the dynamic range of the original image, the invention designs a dynamic selection method which comprises the following steps: the nearest available value is dynamically selected based on the gray value. By the method, isolated points can be reduced, and the image looks more harmonious and natural. And a more convenient condition is provided for converting the later gray-scale image into a multi-channel image, so that the quality of the finally synthesized image is improved.
The fusion is to extract the clear places of the multiple pictures, and then fuse and splice the pictures to form a new picture, but the simple and rough splicing can cause the situations of square block, incoordination and the like, so the pictures are more natural and harmonious by using the fusion processing.
S5: wavelet inverse transformation: reconstructing a high-pass filter and a low-pass filter, performing convolution respectively, then summing, and converting information into a gray image;
s6: the grayscale image of S5 is converted into a multi-channel picture, i.e., a color picture.
In the description herein, references to the description of "one embodiment," "an example," "a specific example" or the like are intended to mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.
Claims (3)
1. A method of resolving depth of field limitations of a microscope, comprising: the method comprises the following steps:
s1: shooting a plurality of pictures in different focal length ranges by using a camera;
s2: pretreatment: converting the shot color picture into a gray image;
s3: performing wavelet transformation: performing complex discrete wavelet transform on the gray level image in the S2 to perform multi-scale decomposition, and obtaining a plurality of subbands containing different scale details, thereby obtaining definition indexes between adjacent domains of pixels of the decomposed sub-image, and extracting detail information of different scales to construct a panoramic focused image;
s4: fusion treatment: for the low-frequency subgraph, obtaining a low-frequency fusion coefficient by using the point sharpness and the fusion measurement in a pixel neighborhood, and for the high-frequency subgraph, fusing by using the sum of Laplacian operators in the pixel neighborhood;
s5: wavelet inverse transformation: reconstructing a high-pass filter and a low-pass filter, performing convolution respectively, then summing, and converting information into a gray image;
s6: the grayscale image of S5 is converted into a multi-channel picture, i.e., a color picture.
2. A method of resolving depth of field limitations of a microscope as claimed in claim 1, wherein: and taking clear pictures in the different focal length ranges, wherein the number of the pictures is 5-8.
3. A method of resolving depth of field limitations of a microscope as claimed in claim 1, wherein: the color picture is a multi-channel image, and a formula for converting the color picture into a gray image is as follows:
where R, G and B are the three channels of the color picture, R represents the value of the position in the R channel, G represents the value of the position in the G channel, and B represents the value of the position in the B channel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110175068.3A CN112801913A (en) | 2021-02-07 | 2021-02-07 | Method for solving field depth limitation of microscope |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110175068.3A CN112801913A (en) | 2021-02-07 | 2021-02-07 | Method for solving field depth limitation of microscope |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112801913A true CN112801913A (en) | 2021-05-14 |
Family
ID=75814839
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110175068.3A Pending CN112801913A (en) | 2021-02-07 | 2021-02-07 | Method for solving field depth limitation of microscope |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112801913A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116523809A (en) * | 2023-07-03 | 2023-08-01 | 首都医科大学附属北京口腔医院 | Image fusion device |
| CN116630220A (en) * | 2023-07-25 | 2023-08-22 | 江苏美克医学技术有限公司 | Fluorescent image depth-of-field fusion imaging method, device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102609931A (en) * | 2012-02-01 | 2012-07-25 | 广州市明美光电技术有限公司 | Field depth expanding method and device of microscopic image |
| CN108694708A (en) * | 2017-04-07 | 2018-10-23 | 南京理工大学 | Wavelet image fusion method based on Edge extraction |
| CN109300098A (en) * | 2018-08-17 | 2019-02-01 | 华东师范大学 | A kind of multi-focus microscopic image fusing method based on wavelet transformation |
| CN109447930A (en) * | 2018-10-26 | 2019-03-08 | 太原科技大学 | Wavelet field light field total focus image generation algorithm |
-
2021
- 2021-02-07 CN CN202110175068.3A patent/CN112801913A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102609931A (en) * | 2012-02-01 | 2012-07-25 | 广州市明美光电技术有限公司 | Field depth expanding method and device of microscopic image |
| CN108694708A (en) * | 2017-04-07 | 2018-10-23 | 南京理工大学 | Wavelet image fusion method based on Edge extraction |
| CN109300098A (en) * | 2018-08-17 | 2019-02-01 | 华东师范大学 | A kind of multi-focus microscopic image fusing method based on wavelet transformation |
| CN109447930A (en) * | 2018-10-26 | 2019-03-08 | 太原科技大学 | Wavelet field light field total focus image generation algorithm |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116523809A (en) * | 2023-07-03 | 2023-08-01 | 首都医科大学附属北京口腔医院 | Image fusion device |
| CN116523809B (en) * | 2023-07-03 | 2023-10-17 | 首都医科大学附属北京口腔医院 | Image fusion device |
| CN116630220A (en) * | 2023-07-25 | 2023-08-22 | 江苏美克医学技术有限公司 | Fluorescent image depth-of-field fusion imaging method, device and storage medium |
| CN116630220B (en) * | 2023-07-25 | 2023-11-21 | 江苏美克医学技术有限公司 | Fluorescent image depth-of-field fusion imaging method, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Li et al. | Underwater image enhancement by dehazing and color correction | |
| Forster et al. | Complex wavelets for extended depth‐of‐field: A new method for the fusion of multichannel microscopy images | |
| JP5705096B2 (en) | Image processing apparatus and image processing method | |
| KR101612165B1 (en) | Method for producing super-resolution images and nonlinear digital filter for implementing same | |
| US8559744B2 (en) | Method for processing a digital object and related system | |
| CN101685534B (en) | Image processing device and image processing method | |
| JP2013084152A (en) | Method for generating omnifocal image, omnifocal image generating device, omnifocal image generating program, method for acquiring subject height information, subject height information acquiring device, and subject height information acquiring program | |
| CN112801913A (en) | Method for solving field depth limitation of microscope | |
| EP3902238A1 (en) | Image processing device, image processing program, image processing method, and imaging device | |
| CN111260580B (en) | Image denoising method, computer device and computer readable storage medium | |
| WO2015156378A1 (en) | Image processing apparatus, image processing method, and image processing system | |
| Gourrame et al. | A zero-bit Fourier image watermarking for print-cam process | |
| Iwanami et al. | An adaptive contrast enhancement using regional dynamic histogram equalization | |
| CN116051428B (en) | Deep learning-based combined denoising and superdivision low-illumination image enhancement method | |
| CN114240789A (en) | Infrared image histogram equalization enhancement method based on optimized brightness keeping | |
| JP2015108837A (en) | Image processing apparatus and image processing method | |
| CN109300098B (en) | Multi-focus microscopic image fusion method based on wavelet transformation | |
| Panikkasseril Sethumadhavan et al. | Transform domain pyramidal dilated convolution networks for restoration of under display camera images | |
| DE112012004470T5 (en) | Image processing apparatus, image processing method, image pickup apparatus, computer program and recording medium | |
| Zhi-guo et al. | A wavelet based algorithm for multi-focus micro-image fusion | |
| CN102158731A (en) | Image processing system and method | |
| US11892615B2 (en) | Image processing method for microscopic image, computer readable medium, image processing apparatus, image processing system, and microscope system | |
| Barai et al. | Human visual system inspired saliency guided edge preserving tone-mapping for high dynamic range imaging | |
| CN114881907B (en) | Optical microscopic image multi-depth-of-field focus synthesis method and system and image processing method | |
| CN102158730B (en) | Image processing system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210514 |