CN111260573A - Method for eliminating vignetting phenomenon in surgical microscopic imaging - Google Patents
Method for eliminating vignetting phenomenon in surgical microscopic imaging Download PDFInfo
- Publication number
- CN111260573A CN111260573A CN202010032735.8A CN202010032735A CN111260573A CN 111260573 A CN111260573 A CN 111260573A CN 202010032735 A CN202010032735 A CN 202010032735A CN 111260573 A CN111260573 A CN 111260573A
- Authority
- CN
- China
- Prior art keywords
- vignetting
- image
- threshold
- compensation
- intensity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 41
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000012937 correction Methods 0.000 claims abstract description 38
- 230000000694 effects Effects 0.000 claims abstract description 17
- 238000005316 response function Methods 0.000 claims abstract description 15
- 238000005286 illumination Methods 0.000 claims abstract description 6
- 238000006243 chemical reaction Methods 0.000 claims description 13
- 230000009466 transformation Effects 0.000 claims description 3
- 238000000386 microscopy Methods 0.000 claims 3
- 238000012545 processing Methods 0.000 abstract description 3
- 230000003287 optical effect Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000012634 optical imaging Methods 0.000 description 3
- 238000011426 transformation method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 244000005700 microbiome Species 0.000 description 1
- 238000002406 microsurgery Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Microscoopes, Condenser (AREA)
Abstract
本发明实施例公开了一种手术显微成像中渐晕现象的消除方法,涉及图像处理技术领域,所述方法包括:获取手术显微成像系统的响应函数和最大照度比;构建渐晕补偿模型;对所述渐晕补偿模型进行修正;获取显微手术图像的渐晕强度,设置渐晕补偿阈值和伽马校正阈值,其中,渐晕补偿阈值大于伽马校正阈值;判断所述渐晕强度与渐晕补偿阈值和伽马校正阈值的大小关系,进行迭代校正,得到无渐晕效果的输出图像。本发明实施例能够解决现有手术显微成像中存在的渐晕现象影响成像的效果的问题。
The embodiment of the invention discloses a method for eliminating vignetting phenomenon in surgical microscope imaging, which relates to the technical field of image processing. The method includes: acquiring a response function and a maximum illumination ratio of a surgical microscope imaging system; building a vignetting compensation model ; modify the vignetting compensation model; obtain the vignetting intensity of the microsurgical image, set a vignetting compensation threshold and a gamma correction threshold, wherein the vignetting compensation threshold is greater than the gamma correction threshold; determine the vignetting intensity Iterative correction is performed according to the relationship between the vignetting compensation threshold and the gamma correction threshold to obtain an output image without vignetting effect. The embodiments of the present invention can solve the problem that the vignetting phenomenon existing in the existing surgical microscopic imaging affects the imaging effect.
Description
技术领域technical field
本发明实施例涉及图像处理技术领域,具体涉及一种手术显微成像中渐晕现象的消除方法。Embodiments of the present invention relate to the technical field of image processing, and in particular, to a method for eliminating vignetting in surgical microscopic imaging.
背景技术Background technique
在光学成像系统中,距离光轴较远的物点相对于光轴附近的物点进光量逐渐减少,从而导致像面的照度从光轴中心向边缘非线性衰减,这种现象称为渐晕效应。手术显微成像在显微外科手术领域应用越来越广泛,而光学渐晕效应直接影响着手术显微成像采集系统的图像质量,从而影响了手术显微成像的效果。In an optical imaging system, the amount of light entering an object point farther from the optical axis gradually decreases relative to an object point near the optical axis, resulting in a nonlinear attenuation of the illuminance of the image plane from the center of the optical axis to the edge. This phenomenon is called vignetting effect. Surgical microscopic imaging is more and more widely used in the field of microsurgery, and the optical vignetting effect directly affects the image quality of the surgical microscopic imaging acquisition system, thus affecting the effect of surgical microscopic imaging.
现有的解决方法有以下两种方式,一种是根据显微成像渐晕的半径缩小成像范围,故所成图像中心以渐晕半径为圆的范围内呈现画面,其他范围都是黑色,但该方法减小了视野范围;另一种是根据图像周边的渐晕区域的照度来整体调节图像的白平衡,虽然该方法在不改变视野范围的情况下可有效的减轻渐晕现象,但是当渐晕效果较明显的时图像中心很容易产生过曝。There are two existing solutions: one is to reduce the imaging range according to the vignetting radius of the microscopic imaging, so the center of the formed image presents the picture within the range of the vignetting radius as the circle, and the other ranges are all black, but This method reduces the field of view; the other is to adjust the white balance of the image as a whole according to the illuminance of the vignetting area around the image, although this method can effectively reduce the vignetting phenomenon without changing the field of view, but when When the vignetting effect is obvious, the center of the image is easily overexposed.
由此可见,以上两种方式具有一定的缺陷,均不是最优的方案,不能很好的解决手术显微成像中的渐晕现象。It can be seen that the above two methods have certain defects, and neither is the optimal solution, and cannot solve the vignetting phenomenon in surgical microscopic imaging very well.
发明内容SUMMARY OF THE INVENTION
本发明实施例的目的在于提供一种手术显微成像中渐晕现象的消除方法,用以解决现有手术显微成像中存在的渐晕现象影响成像的效果的问题。The purpose of the embodiments of the present invention is to provide a method for eliminating the vignetting phenomenon in surgical microscopic imaging, so as to solve the problem that the vignetting phenomenon in the existing surgical microscopic imaging affects the imaging effect.
为实现上述目的,本发明实施例主要提供如下技术方案:To achieve the above purpose, the embodiments of the present invention mainly provide the following technical solutions:
第一方面,本发明实施例提供了一种手术显微成像中渐晕现象的消除方法,所述方法包括:获取手术显微成像系统的响应函数和最大照度比;构建渐晕补偿模型;对所述渐晕补偿模型进行修正;获取显微手术图像的渐晕强度,设置渐晕补偿阈值和伽马校正阈值,其中,渐晕补偿阈值大于伽马校正阈值;判断所述渐晕强度与渐晕补偿阈值和伽马校正阈值的大小关系,进行迭代校正,得到无渐晕效果的输出图像。In a first aspect, an embodiment of the present invention provides a method for eliminating vignetting in surgical microscopic imaging, the method comprising: acquiring a response function and a maximum illuminance ratio of a surgical microscopic imaging system; building a vignetting compensation model; The vignetting compensation model is corrected; the vignetting intensity of the microsurgical image is obtained, and the vignetting compensation threshold and the gamma correction threshold are set, wherein the vignetting compensation threshold is greater than the gamma correction threshold; The relationship between the vignetting compensation threshold and the gamma correction threshold is iteratively corrected to obtain an output image without vignetting effect.
进一步地,所述获取手术显微成像系统的响应函数和最大照度比,具体包括:根据灰度均值选取预设图像,计算预设图像中心坐标的相对辐照量,根据灰度均值与相对辐照量的关系得到响应函数;根据图像中心坐标的相对辐照量与距离图像中心最远点的相对辐照量的比值得到最大照度比。Further, the obtaining of the response function and the maximum illuminance ratio of the surgical microscope imaging system specifically includes: selecting a preset image according to the average gray value, calculating the relative irradiance of the center coordinates of the preset image, and calculating the relative irradiance according to the average gray value and the relative irradiance The response function is obtained from the relationship of the irradiance; the maximum illuminance ratio is obtained according to the ratio of the relative irradiance of the image center coordinates to the relative irradiance of the farthest point from the image center.
进一步地,所述构建渐晕补偿模型,包括:计算图像任意一点坐标与图像中心点坐标的距离,结合手术显微成像系统的响应函数和最大照度比构建图像渐晕补偿函数。Further, the building a vignetting compensation model includes: calculating the distance between the coordinates of any point of the image and the coordinates of the center point of the image, and building an image vignetting compensation function in combination with the response function of the surgical microscope imaging system and the maximum illuminance ratio.
进一步地,对所述渐晕补偿模型进行修正,具体包括:利用SIFT特征匹配模型对手术显微镜的左右视图图像进行特征匹配;利用手术显微镜的左目镜成像的图像修复右目镜的渐晕补偿模型,利用手术显微镜的右目镜成像的图像修复左目镜的渐晕补偿模型,得到修复后的图形渐晕补偿函数。Further, modifying the vignetting compensation model specifically includes: using the SIFT feature matching model to perform feature matching on the left and right view images of the operating microscope; using the image imaged by the left eyepiece of the operating microscope to repair the vignetting compensation model of the right eyepiece, The vignetting compensation model of the left eyepiece is repaired using the image imaged by the right eyepiece of the operating microscope, and the repaired graphic vignetting compensation function is obtained.
进一步地,所述渐晕强度为图像边缘与图像中心的辐照量的比值。Further, the vignetting intensity is the ratio of the irradiance at the edge of the image to the center of the image.
进一步地,所述进行迭代校正,具体包括:当渐晕强度大于渐晕补偿阈值时,直接输出无渐晕效果的图像;当渐晕强度小于渐晕补偿阈值时,对图像进行颜色空间变换后,利用渐晕补偿模型进行补偿校正。Further, the performing iterative correction specifically includes: when the vignetting intensity is greater than the vignetting compensation threshold, directly outputting an image without vignetting effect; when the vignetting intensity is less than the vignetting compensation threshold, performing color space transformation on the image after , and use the vignetting compensation model for compensation correction.
进一步地,所述包括:若所述渐晕强度小于渐晕补偿阈值且大于伽马校正阈值,则选取任意一种颜色空间转换方式进行颜色空间变换;若渐晕强度小于伽马校正阈值,则通过伽马校正方式进行颜色空间转换。Further, the description includes: if the vignetting intensity is less than the vignetting compensation threshold and greater than the gamma correction threshold, then selecting any color space conversion method to perform color space transformation; if the vignetting intensity is less than the gamma correction threshold, then Color space conversion by gamma correction.
进一步地,所述方法还包括:在利用渐晕补偿模型对图像进行补偿校正后,利用转换公式将图片的颜色空间转换回RGB,再比较图像的渐晕强度、渐晕补偿阈值和伽马校正阈值之间的大小关系,进行迭代。Further, the method further includes: after using the vignetting compensation model to compensate and correct the image, using a conversion formula to convert the color space of the picture back to RGB, and then comparing the vignetting intensity, vignetting compensation threshold and gamma correction of the image The size relationship between the thresholds is iterated.
本发明实施例提供的技术方案至少具有如下优点:The technical solutions provided by the embodiments of the present invention have at least the following advantages:
本发明实施例通过构建渐晕补偿模型对图像进行校正,针对图片不同的渐晕强度选择不同的颜色空间变换方式,获取更好的校正效果,并进行校正迭代,直至输出不存在渐晕现象的图像,能够在视野范围不变的情况下有效的消除渐晕现象。The embodiment of the present invention corrects the image by constructing a vignetting compensation model, selects different color space transformation methods for different vignetting intensities of the picture, obtains a better correction effect, and performs correction iteration until the output without vignetting phenomenon The image can effectively eliminate the vignetting phenomenon under the condition that the field of view remains unchanged.
附图说明Description of drawings
图1为本发明实施例提供的一种手术显微成像中渐晕现象的消除方法步骤图。FIG. 1 is a step diagram of a method for eliminating vignetting in surgical microscopic imaging according to an embodiment of the present invention.
图2为本发明实施例提供的一种手术显微成像中渐晕现象的消除方法的细化流程图。FIG. 2 is a detailed flowchart of a method for eliminating vignetting in surgical microscopic imaging according to an embodiment of the present invention.
具体实施方式Detailed ways
以下由特定的具体实施例说明本发明的实施方式,熟悉此技术的人士可由本说明书所揭露的内容轻易地了解本发明的其他优点及功效。The embodiments of the present invention are described below by specific embodiments, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification.
以下描述中,为了说明而不是为了限定,提出了诸如特定系统结构、接口、技术之类的具体细节,以便透彻理解本发明。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施例中也可以实现本发明。在其它情况中,省略对众所周知的系统、电路以及方法的详细说明,以免不必要的细节妨碍本发明的描述。In the following description, for purposes of explanation and not limitation, specific details are set forth, such as specific system structures, interfaces, techniques, etc., in order to provide a thorough understanding of the present invention. However, it will be apparent to those skilled in the art that the present invention may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
显微成像系统是指显微镜下观察样品拍照成像的系统。通过调节物镜成像的位置,成像介于目镜的一倍焦距与两倍焦距之间,使物镜所成的像位于目镜前焦点的外侧,经目镜放大得到一个经二次放大的正立实像,当光源足够强时,相机或摄像机的光电元件感光成像。显微成像系统是显微镜与摄像技术相结合的产物,可对人眼无法看到的微生物进行观察拍照,也常被应用在手术场景,用于辅助手术治疗。在显微镜上加接专用连接镜头,接上CCD摄录镜头,再把动态的图像传送到计算机,获得动态图像,从而观察手术中或术后的细胞状态和组织恢复程度。然而现有的显微成像系统得到的图像存在渐晕现象,为了消除此渐晕现象,因此,本发明实施例提供一种手术显微成像中渐晕现象的消除方法,在执行此方法时默认手术显微成像系统已经过精密调校,显微成像中心与光学成像光轴重合,若显微成像中心与光学成像光轴不重合,则可通过平移图像像素等方式实现二者重合。Microscopic imaging system refers to a system that observes samples under a microscope and takes pictures and images. By adjusting the imaging position of the objective lens, the imaging is between one focal length and twice the focal length of the eyepiece, so that the image formed by the objective lens is located outside the front focus of the eyepiece, and a second-magnified upright real image is obtained by magnifying the eyepiece. When the light source is strong enough, the photoelectric elements of the camera or video camera are sensitive to the image. Microscopic imaging system is the product of the combination of microscope and camera technology. It can observe and take pictures of microorganisms that cannot be seen by the human eye. It is also often used in surgical scenes to assist surgical treatment. A special connection lens is attached to the microscope, a CCD camera lens is connected, and the dynamic image is transmitted to the computer to obtain the dynamic image, so as to observe the cell state and tissue recovery degree during or after the operation. However, the images obtained by the existing microscopic imaging system have vignetting phenomenon. In order to eliminate the vignetting phenomenon, the embodiment of the present invention provides a method for eliminating the vignetting phenomenon in surgical microscopic imaging. The surgical microscopic imaging system has been precisely adjusted, and the microscopic imaging center coincides with the optical imaging axis of the optical imaging.
具体地,参考图1,该方法包括:Specifically, referring to Figure 1, the method includes:
步骤S1:获取手术显微成像系统的响应函数和最大照度比;Step S1: obtaining the response function and the maximum illuminance ratio of the surgical microscope imaging system;
获取响应函数的方法包括:根据灰度均值选取预设图像,计算预设图像中心坐标的相对辐照量,根据灰度均值与相对辐照量的关系得到响应函数。The method for obtaining the response function includes: selecting a preset image according to the average gray value, calculating the relative irradiation amount of the center coordinates of the preset image, and obtaining the response function according to the relationship between the gray average value and the relative irradiation amount.
详细地,在固定焦距、固定光圈下拍摄标准灰度板,拍摄一组不同曝光时间下的数字图像I0~In,其曝光时间分别记为t0~tn;In detail, a standard grayscale plate is photographed under a fixed focal length and a fixed aperture, and a group of digital images I 0 -In under different exposure times are photographed, and the exposure times are respectively recorded as t 0 -t n ;
计算图像Ii中心小范围的灰度均值,记为 Calculate the gray mean value of a small range in the center of the image I i , denoted as
取图像中最接近128的数字图片作为预设图像,记为Ip,其中 take the image The digital picture closest to 128 is used as the preset image, denoted as I p , where
记图像Ip上某一感光像元上的辐照量为Hp,图像Ip的曝光时间为tp,记相对辐照量为H*,则相对辐照量为 Denote the irradiation amount on a certain photosensitive pixel on the image I p as H p , the exposure time of the image I p is t p , and denote the relative irradiation amount as H * , then the relative irradiation amount is
记图像Ip的像素中心坐标为(xp1,yp2),因为像元上的照度与曝光时间t无关,故图像的相对辐照量可以表示为 Note that the pixel center coordinates of the image I p are (x p1 , y p2 ), because the illuminance on the pixel has nothing to do with the exposure time t, the relative irradiance of the image can be expressed as
通过该方法,获得每个图像中心灰度均值与的关系,该关系作为手术显微装置的响应函数,记为G=f(H*),其反函数记为H*=f-1(G)。Through this method, the average gray value of the center of each image is obtained and As the response function of the surgical microscope device, this relationship is denoted as G=f(H * ), and its inverse function is denoted as H * =f -1 (G).
获取最大照度比的方法包括:根据图像中心坐标的相对辐照量与距离图像中心最远点的相对辐照量的比值得到最大照度比。The method for obtaining the maximum illuminance ratio includes: obtaining the maximum illuminance ratio according to the ratio of the relative irradiance of the image center coordinate to the relative irradiance of the point farthest from the image center.
详细地,记距离图像中心最远点为(xo1,yo2),图像Ip的像素中心坐标为(xp1,yp2),则其最大照度比值为S,则 In detail, the farthest point from the image center is (x o1 , y o2 ), and the pixel center coordinates of the image I p are (x p1 , y p2 ), then the maximum illuminance ratio is S, then
步骤S2:构建渐晕补偿模型;Step S2: build a vignetting compensation model;
计算图像任意一点坐标与图像中心点坐标的距离,结合手术显微成像系统的响应函数和最大照度比构建图像渐晕补偿函数。Calculate the distance between the coordinates of any point of the image and the coordinates of the center point of the image, and combine the response function of the surgical microscope imaging system and the maximum illumination ratio to construct an image vignetting compensation function.
记图像上任意一点坐标为(xi,yj),中心点坐标为(xs1,ys2),任意一点(xi,yj)与图像中心(xs1,ys2)的距离为D(xi,yj),Note that the coordinates of any point on the image are (x i , y j ), the coordinates of the center point are (x s1 , y s2 ), and the distance between any point ( xi , y j ) and the center of the image (x s1 , y s2 ) is D (x i ,y j ),
则 but
基于距离D(xi,yj)以及步骤S1中获取的手术显微成像采集系统的响应函数G=f(H*)以及最大照度比S,构建图像渐晕补偿函数为:Based on the distance D(x i , y j ) and the response function G=f(H * ) of the surgical microscope imaging acquisition system obtained in step S1 and the maximum illuminance ratio S, the constructed image vignetting compensation function is:
步骤S3:对所述渐晕补偿模型进行修正;Step S3: correcting the vignetting compensation model;
具体地,利用SIFT特征匹配模型对手术显微镜的左右视图图像进行特征匹配;利用手术显微镜的左目镜成像的图像修复右目镜的渐晕补偿模型,利用手术显微镜的右目镜成像的图像修复左目镜的渐晕补偿模型,得到修复后的图形渐晕补偿函数。其中,SIFT,即尺度不变特征变换,Scale-invariant feature transform,是用于图像处理领域的一种描述,这种描述具有尺度不变性,可在图像中检测出关键点,是一种局部特征描述子,可在现有技术查询。Specifically, the SIFT feature matching model is used to perform feature matching on the left and right view images of the operating microscope; the vignetting compensation model of the right eyepiece is repaired using the image imaged by the left eyepiece of the operating microscope, and the left eyepiece image is repaired using the image imaged by the right eyepiece of the operating microscope. Vignetting compensation model, get the repaired graphics vignetting compensation function. Among them, SIFT, Scale-invariant feature transform, is a description used in the field of image processing. This description has scale invariance and can detect key points in images. It is a local feature Descriptors can be queried in the prior art.
详细地,修复后的渐晕补偿模型为手术成像设备,如手术显微镜具有左目镜和右目镜,以利用手术显微镜的左目镜成像的图像修复右目镜的渐晕补偿模型为例:记左侧目镜成像中的特征匹配点的亮度均值为a,即右目镜经过渐晕补偿模型得到的特征匹配点的亮度均值为b,则α为a与b的比值。In detail, the repaired vignetting compensation model is Surgical imaging equipment, such as a surgical microscope with a left eyepiece and a right eyepiece, take the vignetting compensation model of the right eyepiece for image restoration using the image of the left eyepiece of the surgical microscope as an example: record the mean brightness of the feature matching points in the left eyepiece imaging as a , that is, the mean brightness of the feature matching points obtained by the right eyepiece through the vignetting compensation model is b, and α is the ratio of a to b.
步骤S4:获取显微手术图像的渐晕强度,设置渐晕补偿阈值和伽马校正阈值;Step S4: obtaining the vignetting intensity of the microsurgical image, and setting the vignetting compensation threshold and the gamma correction threshold;
记手术显微成像采集系统的渐晕强度为L,该强度的计算为实时图像采集时,使用图像边缘与图像中心的辐照量的比值。The vignetting intensity of the surgical microscope imaging acquisition system is recorded as L, and the calculation of this intensity is the ratio of the irradiance at the edge of the image to the center of the image during real-time image acquisition.
需要说明的是渐晕补偿阈值大于伽马校正阈值。其中,记进行渐晕补偿阈值为L0,该值可通过实验效果获得,优选的L0=0.9。记伽马校正的阈值为L1,该值可通过实验效果获得,优选的L1=0.75。It should be noted that the vignetting compensation threshold is greater than the gamma correction threshold. Wherein, the threshold value for vignetting compensation is recorded as L 0 , which can be obtained through experimental effects, and the preferred value is L 0 =0.9. The threshold value of gamma correction is recorded as L 1 , which can be obtained through experimental results, and the preferred value is L 1 =0.75.
步骤S5:判断所述渐晕强度与渐晕补偿阈值和伽马校正阈值的大小关系,进行迭代校正,得到无渐晕效果的输出图像。Step S5: Determine the magnitude relationship between the vignetting intensity, the vignetting compensation threshold and the gamma correction threshold, perform iterative correction, and obtain an output image without vignetting effect.
参考图2,具体包括:Referring to Figure 2, it specifically includes:
当L>L0时,即渐晕强度大于渐晕补偿阈值时,无需进行渐晕补偿,直接输出无渐晕效果的图像;When L>L 0 , that is, when the vignetting intensity is greater than the vignetting compensation threshold, no vignetting compensation is required, and the image without vignetting effect is directly output;
当L<L0,时,即渐晕强度小于渐晕补偿阈值时,对图像进行RGB颜色空间到YCbCr颜色空间的转换,再利用渐晕补偿模型进行补偿校正。When L<L 0 , that is, when the vignetting intensity is less than the vignetting compensation threshold, the image is converted from the RGB color space to the YCbCr color space, and then the vignetting compensation model is used for compensation correction.
其中,若L1<L<L0,即渐晕强度小于渐晕补偿阈值且大于伽马校正阈值,其暗部细节还是可以显现出来,则选取任意一种颜色空间转换方式进行颜色空间变换,包括但不限于伽马校正方式,此时,RGB颜色空间到YCbCr颜色空间的转换计算公式如下:Among them, if L 1 <L<L 0 , that is, the vignetting intensity is less than the vignetting compensation threshold and greater than the gamma correction threshold, and the dark details can still be displayed, then any color space conversion method is selected for color space conversion, including But it is not limited to the gamma correction method. At this time, the conversion calculation formula from the RGB color space to the YCbCr color space is as follows:
若L<L1时,即渐晕强度小于伽马校正阈值,此时暗部细节不容易显现出来,则通过伽马校正方式进行颜色空间转换,此时,RGB颜色空间到YCbCr颜色空间的转换计算公式如下:If L<L 1 , that is, the vignetting intensity is less than the gamma correction threshold, and the dark details are not easy to appear, then the color space conversion is performed by the gamma correction method. At this time, the conversion calculation from the RGB color space to the YCbCr color space The formula is as follows:
将颜色空间变换后,针对Y或者Y′分量,使用渐晕补偿模型进行校正,获取渐晕补偿后新的Y或者Y′分量;再利用转换公式:After transforming the color space, use the vignetting compensation model to correct the Y or Y' component to obtain the new Y or Y' component after vignetting compensation; then use the conversion formula:
将L1<L<L0的图片的颜色空间转换回RGB;Convert the color space of the picture with L 1 < L < L 0 back to RGB;
利用公式:Use the formula:
将L<L1的图片的颜色空间转换回RGB。Convert the color space of a picture with L < L 1 back to RGB.
将所有图片的颜色空间转换回RGB后,再获取图像的渐晕强度,并根据图像的渐晕强度、渐晕补偿阈值和伽马校正阈值之间的大小关系,进行上述步骤的迭代,直至输出不存在渐晕现象的图像,优选的最大迭代次数为3。After converting the color space of all the pictures back to RGB, the vignetting intensity of the image is obtained, and the above steps are iterated according to the relationship between the vignetting intensity of the image, the vignetting compensation threshold and the gamma correction threshold, until the output For images without vignetting, the preferred maximum number of iterations is 3.
本发明实施例通过构建渐晕补偿模型对图像进行校正,针对图片不同的渐晕强度选择不同的颜色空间变换方式,获取更好的校正效果,并进行校正迭代,直至输出不存在渐晕现象的图像,能够在视野范围不变的情况下有效的消除渐晕现象。The embodiment of the present invention corrects the image by constructing a vignetting compensation model, selects different color space transformation methods for different vignetting intensities of the picture, obtains a better correction effect, and performs correction iteration until the output without vignetting phenomenon The image can effectively eliminate the vignetting phenomenon under the condition that the field of view remains unchanged.
本领域技术人员应该可以意识到,在上述一个或多个示例中,本发明所描述的功能可以用硬件与软件组合来实现。当应用软件时,可以将相应功能存储在计算机可读介质中或者作为计算机可读介质上的一个或多个指令或代码进行传输。计算机可读介质包括计算机存储介质和通信介质,其中通信介质包括便于从一个地方向另一个地方传送计算机程序的任何介质。存储介质可以是通用或专用计算机能够存取的任何可用介质。Those skilled in the art should appreciate that, in one or more of the above examples, the functions described in the present invention may be implemented by a combination of hardware and software. When the software is applied, the corresponding functions may be stored in or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage medium can be any available medium that can be accessed by a general purpose or special purpose computer.
以上所述的具体实施方式,对本发明的目的、技术方案和有益效果进行了进一步详细说明,所应理解的是,以上所述仅为本发明的具体实施方式而已,并不用于限定本发明的保护范围,凡在本发明的技术方案的基础之上,所做的任何修改、等同替换、改进等,均应包括在本发明的保护范围之内。The specific embodiments described above further describe the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above descriptions are only specific embodiments of the present invention, and are not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made on the basis of the technical solution of the present invention shall be included within the protection scope of the present invention.
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010032735.8A CN111260573B (en) | 2020-01-13 | 2020-01-13 | Method for eliminating vignetting phenomenon in operation microscopic imaging |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010032735.8A CN111260573B (en) | 2020-01-13 | 2020-01-13 | Method for eliminating vignetting phenomenon in operation microscopic imaging |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111260573A true CN111260573A (en) | 2020-06-09 |
CN111260573B CN111260573B (en) | 2023-06-02 |
Family
ID=70948753
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010032735.8A Active CN111260573B (en) | 2020-01-13 | 2020-01-13 | Method for eliminating vignetting phenomenon in operation microscopic imaging |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111260573B (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101217674A (en) * | 2007-01-04 | 2008-07-09 | 三星电子株式会社 | Apparatus and method for ambient light adaptive color correction |
CN102629368A (en) * | 2012-02-27 | 2012-08-08 | 天津大学 | Color image vignetting recovery method based on illumination surface modeling |
US20160189353A1 (en) * | 2014-12-23 | 2016-06-30 | Postech Academy - Industry Foundation | Method for vignetting correction of image and apparatus therefor |
US20180089855A1 (en) * | 2015-04-13 | 2018-03-29 | Universidade De Coimbra | Methods and Systems for Camera Characterization in Terms of Response Function, Color, and Vignetting Under Non-Uniform Illumination |
CN108428218A (en) * | 2018-02-28 | 2018-08-21 | 广州布伦南信息科技有限公司 | A kind of image processing method of removal newton halation |
CN110111284A (en) * | 2019-05-14 | 2019-08-09 | 四川大学 | A kind of method, apparatus, electronic equipment and the storage medium of vignetting image rectification |
CN110611748A (en) * | 2019-09-10 | 2019-12-24 | 北方信息控制研究院集团有限公司 | Method for correcting imaging consistency of microscopic field camera array |
-
2020
- 2020-01-13 CN CN202010032735.8A patent/CN111260573B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101217674A (en) * | 2007-01-04 | 2008-07-09 | 三星电子株式会社 | Apparatus and method for ambient light adaptive color correction |
CN102629368A (en) * | 2012-02-27 | 2012-08-08 | 天津大学 | Color image vignetting recovery method based on illumination surface modeling |
US20160189353A1 (en) * | 2014-12-23 | 2016-06-30 | Postech Academy - Industry Foundation | Method for vignetting correction of image and apparatus therefor |
US20180089855A1 (en) * | 2015-04-13 | 2018-03-29 | Universidade De Coimbra | Methods and Systems for Camera Characterization in Terms of Response Function, Color, and Vignetting Under Non-Uniform Illumination |
CN108428218A (en) * | 2018-02-28 | 2018-08-21 | 广州布伦南信息科技有限公司 | A kind of image processing method of removal newton halation |
CN110111284A (en) * | 2019-05-14 | 2019-08-09 | 四川大学 | A kind of method, apparatus, electronic equipment and the storage medium of vignetting image rectification |
CN110611748A (en) * | 2019-09-10 | 2019-12-24 | 北方信息控制研究院集团有限公司 | Method for correcting imaging consistency of microscopic field camera array |
Non-Patent Citations (6)
Title |
---|
ALESSANDRO BEVILACQUA,ET AL.: "Vignetting correction by exploiting an optical microscopy image sequence", 《2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDIVINE AND BIOLOGY SOCIETY》 * |
DANIEL B.GOLDMAN,ET AL.: "Vignette and Exposure Calibration and Compensation", 《IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE》 * |
丁莹等: "视觉系统光学渐晕效应非线性补偿方法", 《清华大学学报(自然科学版)》 * |
崔颖: "图像镶嵌中渐晕现象处理方法研究", 《中国优秀硕士学位论文全文数据库》 * |
朱胜利: "基于移动智能终端的视像信号处理技术研究", 《优秀硕士学位论文全文库 信息科技辑》 * |
肖泉等: "有效消除光晕现象和颜色保持的彩色图像增强算法", 《计算机辅助设计与图形学学报》 * |
Also Published As
Publication number | Publication date |
---|---|
CN111260573B (en) | 2023-06-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019105154A1 (en) | Image processing method, apparatus and device | |
RU2716843C1 (en) | Digital correction of optical system aberrations | |
US9041833B2 (en) | Image processing method, image processing apparatus, and image pickup apparatus | |
US8442347B2 (en) | Information processing apparatus, information processing method, program, and imaging apparatus including optical microscope | |
WO2020107995A1 (en) | Imaging method and apparatus, electronic device, and computer readable storage medium | |
US20180089855A1 (en) | Methods and Systems for Camera Characterization in Terms of Response Function, Color, and Vignetting Under Non-Uniform Illumination | |
CN111986106B (en) | A high dynamic image reconstruction method based on neural network | |
WO2019056549A1 (en) | Image enhancement method, and image processing device | |
JP2009188676A (en) | Imaging apparatus, imaging method, and program | |
CN107079127A (en) | Projector and image display method | |
CN113965664B (en) | Image blurring method, storage medium and terminal equipment | |
JP5730036B2 (en) | Image processing apparatus, imaging apparatus, image processing method, and program. | |
CN111260573B (en) | Method for eliminating vignetting phenomenon in operation microscopic imaging | |
JP2015115733A (en) | Image processing method, image processor, imaging device, and image processing program | |
JP4340303B2 (en) | Image processing apparatus and image processing program | |
CN112565588B (en) | Image processing apparatus, image processing method, and storage medium | |
CN107358591A (en) | A kind of unzoned lens imaging aberrations bearing calibration based on RGB cross aisle priori | |
CN107451971A (en) | The blind convolved image restoring method of low-light (level) of priori is combined based on dark and Gauss | |
CN115546883B (en) | Fundus image processing system | |
JP6487008B1 (en) | High resolution imaging device | |
CN108900734A (en) | A kind of wide-angle lens automatic distortion correction device and method | |
JP2011182189A (en) | Image processing device and image processing program | |
KR20100121944A (en) | Image processing method and apparatus, and digital photographing apparatus using thereof | |
CN110995961B (en) | Method and system for enhancing camera vignetting | |
CN111988577A (en) | Video monitoring method based on image enhancement |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20240311 Address after: 314050 9F, No. 705, Asia Pacific Road, Nanhu District, Jiaxing City, Zhejiang Province Patentee after: ZHEJIANG YANGTZE DELTA REGION INSTITUTE OF TSINGHUA University Country or region after: China Address before: No.152 Huixin Road, Nanhu District, Jiaxing City, Zhejiang Province 314000 Patentee before: ZHEJIANG FUTURE TECHNOLOGY INSTITUTE (JIAXING) Country or region before: China |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20241121 Address after: 314000 room 307, building 1, No. 152, Huixin Road, Daqiao Town, Nanhu District, Jiaxing City, Zhejiang Province Patentee after: Jiaxing Zhitong Technology Co.,Ltd. Country or region after: China Address before: 314050 9F, No. 705, Asia Pacific Road, Nanhu District, Jiaxing City, Zhejiang Province Patentee before: ZHEJIANG YANGTZE DELTA REGION INSTITUTE OF TSINGHUA University Country or region before: China |
|
TR01 | Transfer of patent right |